2024-09-10T22:41:30.895 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T22:41:30.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:41:30.989 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899755' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - host.b - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiCl73gF+QUi6l4WoqjRIa5Gs0NIChuHIQDg73qA5+X5A03mzbP1lvc/0tfnVXa6s5+46Uerj6ro9k539Y9/GE= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGn4QxRZnJvZQwLIYS1FsV28VnoJjm84TKO//dfrAkDjHnJpTJpwGZy29yToMZvtLvxLMUgCzRvh2JoPcskYWQs= tasks: - install: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create foo - ceph fs volume create bar - fs.ready: timeout: 300 - ceph-fuse: client.0: cephfs_name: foo - ceph-fuse: client.1: cephfs_name: bar - workunit: clients: all: - suites/dbench.sh - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T22:41:30.989 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T22:41:30.990 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T22:41:30.990 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T22:41:30.991 INFO:teuthology.task.internal:Checking packages... 2024-09-10T22:41:31.013 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T22:41:31.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T22:41:31.013 INFO:teuthology.packaging:ref: None 2024-09-10T22:41:31.013 INFO:teuthology.packaging:tag: None 2024-09-10T22:41:31.013 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:41:31.013 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:41:31.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:41:31.164 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T22:41:31.166 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T22:41:31.172 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T22:41:31.172 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T22:41:31.183 INFO:teuthology.task.internal:Saving configuration 2024-09-10T22:41:31.196 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T22:41:31.202 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T22:41:31.236 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:36:33.524352', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiCl73gF+QUi6l4WoqjRIa5Gs0NIChuHIQDg73qA5+X5A03mzbP1lvc/0tfnVXa6s5+46Uerj6ro9k539Y9/GE='} 2024-09-10T22:41:31.268 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:36:33.522822', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGn4QxRZnJvZQwLIYS1FsV28VnoJjm84TKO//dfrAkDjHnJpTJpwGZy29yToMZvtLvxLMUgCzRvh2JoPcskYWQs='} 2024-09-10T22:41:31.268 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T22:41:31.274 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-10T22:41:31.274 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-09-10T22:41:31.274 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T22:41:31.352 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4648887be0>, signals=[15]) 2024-09-10T22:41:31.352 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T22:41:31.358 INFO:teuthology.task.internal:Opening connections... 2024-09-10T22:41:31.358 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-09-10T22:41:31.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:41:31.443 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T22:41:31.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:41:31.535 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T22:41:31.541 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-09-10T22:41:31.559 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-09-10T22:41:31.559 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-09-10T22:41:31.616 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T22:41:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T22:41:31.618 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-09-10T22:41:31.650 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-10T22:41:31.669 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-10T22:41:31.669 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-10T22:41:31.726 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-10T22:41:31.726 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T22:41:31.727 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T22:41:31.728 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-10T22:41:31.758 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T22:41:31.766 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T22:41:31.774 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T22:41:31.775 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:41:31.777 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:41:31.794 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T22:41:31.799 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T22:41:31.800 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:41:31.835 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:41:31.862 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T22:41:31.933 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T22:41:31.946 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T22:41:31.946 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'host.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T22:41:31.946 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:41:31.947 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:41:31.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:41:31.963 DEBUG:teuthology.task.kernel:sha1 for host.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:31.964 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T22:41:31.964 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-10T22:41:31.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:41:31.965 DEBUG:teuthology.task.kernel:sha1 for host.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:31.965 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T22:41:31.965 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-10T22:41:32.021 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-10T22:41:32.021 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:32.022 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T22:41:32.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:32.033 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-503.el9.x86_64 2024-09-10T22:41:32.034 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:32.034 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T22:41:32.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:32.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum upgrade -y linux-firmware 2024-09-10T22:41:32.187 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum upgrade -y linux-firmware 2024-09-10T22:41:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-10T22:41:35.770 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-10T22:41:39.754 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-10T22:41:44.214 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-10T22:41:44.721 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.5 MB 00:01 2024-09-10T22:41:46.189 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-10T22:41:47.251 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T22:41:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.5 MB 00:01 2024-09-10T22:41:50.723 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-10T22:41:51.961 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T22:41:52.690 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T22:41:54.798 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:41:54.799 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:41:54.799 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:41:54.899 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.b... 2024-09-10T22:41:54.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:41:55.055 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T22:41:55.056 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T22:41:55.058 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2024-09-10T22:41:57.733 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-09-10T22:41:59.931 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:41:59.932 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:41:59.932 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:42:00.029 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.a... 2024-09-10T22:42:00.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:42:00.185 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T22:42:00.185 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T22:42:00.188 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi046.front.sepia.ceph.com to complete... 2024-09-10T22:42:02.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10 22:42:02 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T22:42:02.576 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2024-09-10 22:42:02-- 2024-09-10T22:42:02.577 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 7.5s 2024-09-10T22:42:02.577 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 343M in 7.1s (48.5 MB/s) 2024-09-10T22:42:02.579 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.b... 2024-09-10T22:42:02.579 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T22:42:04.745 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying... ######################################## 2024-09-10T22:42:04.977 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing... ######################################## 2024-09-10T22:42:05.082 INFO:teuthology.orchestra.run.smithi073.stdout:Updating / installing... 2024-09-10T22:42:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10 22:42:08 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T22:42:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:FINISHED --2024-09-10 22:42:08-- 2024-09-10T22:42:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:Total wall clock time: 8.1s 2024-09-10T22:42:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:Downloaded: 1 files, 343M in 7.6s (44.9 MB/s) 2024-09-10T22:42:08.283 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.a... 2024-09-10T22:42:08.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T22:42:10.529 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying... ######################################## 2024-09-10T22:42:10.675 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing... ######################################## 2024-09-10T22:42:10.781 INFO:teuthology.orchestra.run.smithi046.stdout:Updating / installing... 2024-09-10T22:42:13.045 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T22:42:19.110 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T22:42:52.986 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T22:42:52.987 DEBUG:teuthology.orchestra.run.smithi073:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T22:42:53.073 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T22:42:53.074 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T22:42:53.075 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T22:42:53.076 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T22:42:53.077 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T22:42:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T22:42:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T22:42:53.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T22:42:53.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T22:42:53.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T22:42:53.080 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T22:42:53.081 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T22:42:53.082 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T22:42:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T22:42:53.084 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T22:42:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T22:42:53.086 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T22:42:53.087 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T22:42:53.088 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T22:42:53.089 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T22:42:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T22:42:53.091 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T22:42:53.092 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T22:42:53.093 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T22:42:53.094 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T22:42:53.095 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T22:42:53.096 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T22:42:53.097 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T22:42:53.098 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T22:42:53.099 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T22:42:53.100 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T22:42:53.101 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T22:42:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T22:42:53.103 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T22:42:53.104 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T22:42:53.105 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T22:42:53.106 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T22:42:53.107 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T22:42:53.108 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T22:42:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T22:42:53.110 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T22:42:53.111 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T22:42:53.112 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T22:42:53.113 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T22:42:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T22:42:53.115 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T22:42:53.116 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T22:42:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T22:42:53.118 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T22:42:53.119 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T22:42:53.120 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T22:42:53.121 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T22:42:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T22:42:53.123 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T22:42:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T22:42:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T22:42:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T22:42:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T22:42:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T22:42:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T22:42:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T22:42:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T22:42:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T22:42:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T22:42:53.134 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T22:42:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T22:42:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T22:42:53.137 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T22:42:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T22:42:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T22:42:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T22:42:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T22:42:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T22:42:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T22:42:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T22:42:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T22:42:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T22:42:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T22:42:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T22:42:53.146 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T22:42:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T22:42:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T22:42:53.149 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T22:42:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T22:42:53.151 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T22:42:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T22:42:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T22:42:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T22:42:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T22:42:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T22:42:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T22:42:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T22:42:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T22:42:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T22:42:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T22:42:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T22:42:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T22:42:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T22:42:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T22:42:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T22:42:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T22:42:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T22:42:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T22:42:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T22:42:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T22:42:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T22:42:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T22:42:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T22:42:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T22:42:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T22:42:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T22:42:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T22:42:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T22:42:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T22:42:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T22:42:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T22:42:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T22:42:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T22:42:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T22:42:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T22:42:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T22:42:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T22:42:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T22:42:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T22:42:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T22:42:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T22:42:53.188 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T22:42:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T22:42:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T22:42:53.191 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T22:42:53.192 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T22:42:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T22:42:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T22:42:53.195 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T22:42:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T22:42:53.197 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T22:42:53.198 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T22:42:53.199 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T22:42:53.200 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T22:42:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T22:42:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T22:42:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T22:42:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T22:42:53.205 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T22:42:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T22:42:53.207 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T22:42:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T22:42:53.209 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T22:42:53.210 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T22:42:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T22:42:53.212 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T22:42:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T22:42:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T22:42:53.215 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T22:42:53.216 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T22:42:53.217 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T22:42:53.218 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T22:42:53.219 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T22:42:53.220 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T22:42:53.221 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T22:42:53.222 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T22:42:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T22:42:53.224 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T22:42:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T22:42:53.229 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.229 DEBUG:teuthology.orchestra.run.smithi073:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T22:42:53.253 INFO:teuthology.orchestra.run.smithi073.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T22:42:53.253 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout:for file in vmlinuz System.map config; do 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: fi 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T22:42:53.254 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.255 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-09-10T22:42:53.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-10T22:42:53.326 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T22:42:53.327 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-10T22:42:53.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:42:53.329 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T22:42:53.329 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T22:42:53.329 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:53.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T22:42:53.929 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-10T22:42:55.380 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T22:42:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-10T22:42:55.412 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-10T22:42:55.437 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.ePYZOnIOXm 2024-09-10T22:42:55.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ePYZOnIOXm 2024-09-10T22:42:55.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.ePYZOnIOXm 2024-09-10T22:42:55.656 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.ePYZOnIOXm is 6KB 2024-09-10T22:42:55.705 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.ePYZOnIOXm 2024-09-10T22:42:55.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T22:42:55.795 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T22:42:55.795 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T22:42:55.795 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T22:42:55.795 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T22:42:55.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:55.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-10T22:42:58.822 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T22:42:58.822 DEBUG:teuthology.orchestra.run.smithi046:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T22:42:58.895 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:58.895 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:58.895 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T22:42:58.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T22:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T22:42:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T22:42:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T22:42:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T22:42:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T22:42:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T22:42:58.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T22:42:58.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T22:42:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T22:42:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T22:42:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T22:42:58.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T22:42:58.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T22:42:58.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T22:42:58.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T22:42:58.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T22:42:58.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T22:42:58.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T22:42:58.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T22:42:58.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T22:42:58.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T22:42:58.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T22:42:58.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T22:42:58.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T22:42:58.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T22:42:58.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T22:42:58.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T22:42:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T22:42:58.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T22:42:58.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T22:42:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T22:42:58.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T22:42:58.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T22:42:58.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T22:42:58.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T22:42:58.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T22:42:58.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T22:42:58.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T22:42:58.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T22:42:58.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T22:42:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T22:42:58.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T22:42:58.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T22:42:58.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T22:42:58.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T22:42:58.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T22:42:58.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T22:42:58.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T22:42:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T22:42:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T22:42:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T22:42:58.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T22:42:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T22:42:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T22:42:58.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T22:42:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T22:42:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T22:42:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T22:42:58.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T22:42:58.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T22:42:58.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T22:42:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T22:42:58.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T22:42:58.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T22:42:58.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T22:42:58.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T22:42:58.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T22:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T22:42:58.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T22:42:58.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T22:42:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T22:42:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T22:42:58.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T22:42:58.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T22:42:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T22:42:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T22:42:58.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T22:42:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T22:42:58.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T22:42:58.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T22:42:58.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T22:42:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T22:42:58.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T22:42:58.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T22:42:58.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T22:42:58.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T22:42:58.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T22:42:58.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T22:42:58.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T22:42:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T22:42:58.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T22:42:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T22:42:58.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T22:42:58.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T22:42:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T22:42:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T22:42:58.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T22:42:58.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T22:42:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T22:42:58.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T22:42:58.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T22:42:58.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T22:42:58.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T22:42:59.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T22:42:59.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T22:42:59.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T22:42:59.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T22:42:59.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T22:42:59.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T22:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T22:42:59.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T22:42:59.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T22:42:59.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T22:42:59.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T22:42:59.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T22:42:59.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T22:42:59.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T22:42:59.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T22:42:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T22:42:59.012 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T22:42:59.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T22:42:59.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T22:42:59.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T22:42:59.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T22:42:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T22:42:59.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T22:42:59.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T22:42:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T22:42:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T22:42:59.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T22:42:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T22:42:59.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T22:42:59.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T22:42:59.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T22:42:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T22:42:59.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T22:42:59.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T22:42:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T22:42:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T22:42:59.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T22:42:59.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T22:42:59.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T22:42:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T22:42:59.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T22:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T22:42:59.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T22:42:59.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T22:42:59.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T22:42:59.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T22:42:59.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T22:42:59.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T22:42:59.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T22:42:59.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T22:42:59.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T22:42:59.046 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:59.046 DEBUG:teuthology.orchestra.run.smithi046:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T22:42:59.071 INFO:teuthology.orchestra.run.smithi046.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T22:42:59.071 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout:for file in vmlinuz System.map config; do 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: fi 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout:done 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-09-10T22:42:59.072 INFO:teuthology.orchestra.run.smithi046.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T22:42:59.073 INFO:teuthology.orchestra.run.smithi046.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:59.073 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-09-10T22:42:59.073 INFO:teuthology.orchestra.run.smithi046.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T22:42:59.073 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T22:42:59.073 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:59.073 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-09-10T22:42:59.074 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-09-10T22:42:59.158 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-09-10T22:42:59.158 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 82.el9 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8274670 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-09-10T22:42:59.159 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:42:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T22:42:59.161 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T22:42:59.161 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:42:59.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T22:42:59.769 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-09-10T22:43:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T22:43:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-09-10T22:43:01.190 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-10T22:43:01.206 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.jc4RwIv2VP 2024-09-10T22:43:01.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jc4RwIv2VP 2024-09-10T22:43:01.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.jc4RwIv2VP 2024-09-10T22:43:01.409 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.jc4RwIv2VP is 6KB 2024-09-10T22:43:01.457 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.jc4RwIv2VP 2024-09-10T22:43:01.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T22:43:01.534 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T22:43:01.534 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T22:43:01.534 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T22:43:01.534 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T22:43:01.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:43:01.688 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-09-10T22:43:25.969 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-10T22:43:25.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T22:43:25.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:43:31.696 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-10T22:43:31.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:43:31.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:43:44.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-10T22:43:50.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-10T22:43:53.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T22:43:53.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:43:56.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-10T22:43:59.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:43:59.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:44:02.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-10T22:44:08.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T22:44:08.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:44:14.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:44:14.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:44:32.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-10T22:44:40.428 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-10T22:44:40.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T22:44:40.970 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T22:44:40.970 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-10T22:44:41.004 INFO:teuthology.orchestra.run.smithi073.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:44:41.004 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:44:41.004 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T22:44:41.005 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T22:44:42.005 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-10T22:44:42.006 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T22:44:42.143 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-10T22:44:42.165 DEBUG:teuthology.parallel:result is None 2024-09-10T22:44:47.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:44:47.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:44:51.529 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-10T22:44:52.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:44:52.123 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T22:44:52.123 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-10T22:44:52.158 INFO:teuthology.orchestra.run.smithi046.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:44:52.158 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:44:52.159 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T22:44:52.159 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T22:44:53.160 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-10T22:44:53.160 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T22:44:53.299 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-09-10T22:44:53.329 DEBUG:teuthology.parallel:result is None 2024-09-10T22:44:53.329 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T22:44:53.338 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T22:44:53.338 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:44:53.341 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:44:53.377 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T22:44:53.383 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T22:44:53.394 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T22:44:53.394 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:44:53.418 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:44:53.799 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T22:44:53.806 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T22:44:53.806 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:44:53.811 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:44:53.873 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:44:53.890 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:44:53.895 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:44:53.915 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:44:53.918 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T22:44:53.926 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T22:44:53.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:44:53.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:44:53.987 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T22:44:53.996 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T22:44:53.996 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:44:54.000 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:44:54.036 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:44:54.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:44:54.218 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:44:54.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:44:54.355 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:44:54.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:44:54.411 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:44:54.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:44:54.554 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:44:54.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:44:54.687 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:44:54.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:44:54.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-09-10T22:44:54.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-10T22:44:54.833 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:44:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:44:55.221 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T22:44:55.228 INFO:teuthology.task.internal:Starting timer... 2024-09-10T22:44:55.228 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T22:44:55.238 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T22:44:55.246 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T22:44:55.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-09-10T22:44:55.325 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-09-10T22:44:55.329 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-10T22:44:55.408 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-10T22:44:55.411 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T22:44:55.412 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-09-10T22:44:55.452 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-09-10T22:44:55.452 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-10T22:44:55.490 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-10T22:44:55.491 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-09-10T22:44:55.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T22:44:55.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:44:55.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T22:44:55.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:44:55.603 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T22:44:55.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-09-10T22:44:55.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-10T22:44:55.734 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T22:44:55.743 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T22:44:55.754 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T22:44:55.755 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T22:49:36.217 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-09-10T22:49:36.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:49:36.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:49:36.313 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-10T22:49:36.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-10T22:49:36.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T22:49:36.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:49:36.505 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-10T22:49:36.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T22:49:36.622 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T22:49:36.631 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T22:49:36.632 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:49:36.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:49:36.636 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:49:36.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:49:36.692 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:49:36.722 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:49:36.723 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:49:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:49:36.774 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-09-10T22:49:36.798 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-09-10T22:49:36.803 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-10T22:49:36.827 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:49:36.828 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-10T22:49:36.856 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:49:36.857 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:49:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:49:36.952 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:49:36.959 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:49:36.960 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-10T22:49:36.960 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.960 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.960 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.960 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.989 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:49:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:49:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-10T22:49:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:49:36.997 INFO:teuthology.run_tasks:Running task install... 2024-09-10T22:49:37.005 DEBUG:teuthology.task.install:project ceph 2024-09-10T22:49:37.005 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T22:49:37.005 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T22:49:37.005 INFO:teuthology.task.install:Using flavor: default 2024-09-10T22:49:37.013 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T22:49:37.013 INFO:teuthology.task.install:extra packages: [] 2024-09-10T22:49:37.013 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:49:37.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:49:37.015 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:49:37.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:49:37.166 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:49:37.166 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:49:37.177 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:49:37.177 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:49:37.286 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:49:37.286 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:49:37.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:49:37.295 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:49:37.295 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:49:37.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:49:37.343 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T22:49:37.343 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:49:37.351 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T22:49:37.352 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:49:37.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:49:37.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:49:37.523 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:49:37.527 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:49:37.581 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-10T22:49:37.583 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-09-10T22:49:37.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-10T22:49:37.586 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-09-10T22:49:37.858 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-10T22:49:37.873 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-09-10T22:49:37.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2024-09-10T22:49:37.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw 2024-09-10T22:49:38.564 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-10T22:49:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 286 kB/s | 84 kB 00:00 2024-09-10T22:49:38.873 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-10T22:49:38.908 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-10T22:49:39.174 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 7.3 kB/s | 1.9 kB 00:00 2024-09-10T22:49:39.201 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-10T22:49:39.712 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-10T22:49:39.891 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-10T22:49:41.702 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-10T22:49:41.901 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-10T22:49:46.503 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-10T22:49:47.460 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T22:49:48.129 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-10T22:49:49.060 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-10T22:49:49.500 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T22:49:50.423 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T22:49:56.115 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-10T22:49:56.796 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T22:49:58.773 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:49:58.786 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:49:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:49:58.788 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout:Install 31 Packages 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-09-10T22:49:58.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:49:58.790 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 62 M 2024-09-10T22:49:58.790 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:49:59.392 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:49:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:49:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:49:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:Install 31 Packages 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-09-10T22:49:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:49:59.410 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 62 M 2024-09-10T22:49:59.410 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:49:59.591 INFO:teuthology.orchestra.run.smithi046.stdout:(1/33): ceph-base-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-10T22:49:59.666 INFO:teuthology.orchestra.run.smithi046.stdout:(2/33): ceph-selinux-19.3.0-4854.g8f219c47.el9. 335 kB/s | 25 kB 00:00 2024-09-10T22:49:59.792 INFO:teuthology.orchestra.run.smithi046.stdout:(3/33): ceph-radosgw-19.3.0-4854.g8f219c47.el9. 15 MB/s | 11 MB 00:00 2024-09-10T22:49:59.825 INFO:teuthology.orchestra.run.smithi046.stdout:(4/33): libcephfs2-19.3.0-4854.g8f219c47.el9.x8 4.7 MB/s | 755 kB 00:00 2024-09-10T22:49:59.867 INFO:teuthology.orchestra.run.smithi046.stdout:(5/33): libradosstriper1-19.3.0-4854.g8f219c47. 6.6 MB/s | 507 kB 00:00 2024-09-10T22:49:59.951 INFO:teuthology.orchestra.run.smithi046.stdout:(6/33): python3-ceph-argparse-19.3.0-4854.g8f21 542 kB/s | 45 kB 00:00 2024-09-10T22:50:00.101 INFO:teuthology.orchestra.run.smithi046.stdout:(7/33): librgw2-19.3.0-4854.g8f219c47.el9.x86_6 20 MB/s | 5.5 MB 00:00 2024-09-10T22:50:00.135 INFO:teuthology.orchestra.run.smithi046.stdout:(8/33): python3-ceph-common-19.3.0-4854.g8f219c 779 kB/s | 143 kB 00:00 2024-09-10T22:50:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:(9/33): python3-cephfs-19.3.0-4854.g8f219c47.el 2.7 MB/s | 161 kB 00:00 2024-09-10T22:50:00.193 INFO:teuthology.orchestra.run.smithi046.stdout:(10/33): python3-rados-19.3.0-4854.g8f219c47.el 5.4 MB/s | 321 kB 00:00 2024-09-10T22:50:00.218 INFO:teuthology.orchestra.run.smithi046.stdout:(11/33): python3-rbd-19.3.0-4854.g8f219c47.el9. 5.1 MB/s | 306 kB 00:00 2024-09-10T22:50:00.244 INFO:teuthology.orchestra.run.smithi046.stdout:(12/33): python3-rgw-19.3.0-4854.g8f219c47.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T22:50:00.361 INFO:teuthology.orchestra.run.smithi046.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 754 kB/s | 107 kB 00:00 2024-09-10T22:50:00.386 INFO:teuthology.orchestra.run.smithi046.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-10T22:50:00.520 INFO:teuthology.orchestra.run.smithi073.stdout:(1/33): ceph-base-19.3.0-4854.g8f219c47.el9.x86 6.7 MB/s | 5.5 MB 00:00 2024-09-10T22:50:00.563 INFO:teuthology.orchestra.run.smithi073.stdout:(2/33): ceph-selinux-19.3.0-4854.g8f219c47.el9. 580 kB/s | 25 kB 00:00 2024-09-10T22:50:00.603 INFO:teuthology.orchestra.run.smithi046.stdout:(15/33): ceph-common-19.3.0-4854.g8f219c47.el9. 14 MB/s | 22 MB 00:01 2024-09-10T22:50:00.645 INFO:teuthology.orchestra.run.smithi046.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 175 kB/s | 45 kB 00:00 2024-09-10T22:50:00.655 INFO:teuthology.orchestra.run.smithi073.stdout:(3/33): libcephfs2-19.3.0-4854.g8f219c47.el9.x8 8.1 MB/s | 755 kB 00:00 2024-09-10T22:50:00.670 INFO:teuthology.orchestra.run.smithi046.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 518 kB/s | 160 kB 00:00 2024-09-10T22:50:00.729 INFO:teuthology.orchestra.run.smithi046.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 726 kB/s | 42 kB 00:00 2024-09-10T22:50:00.747 INFO:teuthology.orchestra.run.smithi073.stdout:(4/33): libradosstriper1-19.3.0-4854.g8f219c47. 5.4 MB/s | 507 kB 00:00 2024-09-10T22:50:00.763 INFO:teuthology.orchestra.run.smithi046.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-10T22:50:00.788 INFO:teuthology.orchestra.run.smithi046.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T22:50:00.830 INFO:teuthology.orchestra.run.smithi046.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 538 kB/s | 36 kB 00:00 2024-09-10T22:50:00.872 INFO:teuthology.orchestra.run.smithi046.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-10T22:50:00.923 INFO:teuthology.orchestra.run.smithi046.stdout:(23/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-10T22:50:00.981 INFO:teuthology.orchestra.run.smithi073.stdout:(5/33): ceph-radosgw-19.3.0-4854.g8f219c47.el9. 8.5 MB/s | 11 MB 00:01 2024-09-10T22:50:00.998 INFO:teuthology.orchestra.run.smithi046.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 358 kB/s | 26 kB 00:00 2024-09-10T22:50:01.040 INFO:teuthology.orchestra.run.smithi046.stdout:(25/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.4 MB/s | 309 kB 00:00 2024-09-10T22:50:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:(6/33): python3-ceph-argparse-19.3.0-4854.g8f21 779 kB/s | 45 kB 00:00 2024-09-10T22:50:01.082 INFO:teuthology.orchestra.run.smithi046.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-10T22:50:01.099 INFO:teuthology.orchestra.run.smithi073.stdout:(7/33): python3-ceph-common-19.3.0-4854.g8f219c 2.4 MB/s | 143 kB 00:00 2024-09-10T22:50:01.107 INFO:teuthology.orchestra.run.smithi046.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-10T22:50:01.157 INFO:teuthology.orchestra.run.smithi046.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2024-09-10T22:50:01.224 INFO:teuthology.orchestra.run.smithi046.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-10T22:50:01.232 INFO:teuthology.orchestra.run.smithi073.stdout:(8/33): librgw2-19.3.0-4854.g8f219c47.el9.x86_6 11 MB/s | 5.5 MB 00:00 2024-09-10T22:50:01.257 INFO:teuthology.orchestra.run.smithi073.stdout:(9/33): python3-cephfs-19.3.0-4854.g8f219c47.el 1.0 MB/s | 161 kB 00:00 2024-09-10T22:50:01.291 INFO:teuthology.orchestra.run.smithi073.stdout:(10/33): python3-rados-19.3.0-4854.g8f219c47.el 5.4 MB/s | 321 kB 00:00 2024-09-10T22:50:01.316 INFO:teuthology.orchestra.run.smithi073.stdout:(11/33): python3-rbd-19.3.0-4854.g8f219c47.el9. 5.1 MB/s | 306 kB 00:00 2024-09-10T22:50:01.350 INFO:teuthology.orchestra.run.smithi046.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-10T22:50:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:(12/33): python3-rgw-19.3.0-4854.g8f219c47.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T22:50:01.408 INFO:teuthology.orchestra.run.smithi046.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-10T22:50:01.500 INFO:teuthology.orchestra.run.smithi046.stdout:(32/33): librados2-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-10T22:50:01.592 INFO:teuthology.orchestra.run.smithi046.stdout:(33/33): librbd1-19.3.0-4854.g8f219c47.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-10T22:50:01.597 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:50:01.597 INFO:teuthology.orchestra.run.smithi046.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-10T22:50:01.609 INFO:teuthology.orchestra.run.smithi073.stdout:(13/33): ceph-common-19.3.0-4854.g8f219c47.el9. 11 MB/s | 22 MB 00:01 2024-09-10T22:50:01.659 INFO:teuthology.orchestra.run.smithi073.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 312 kB/s | 107 kB 00:00 2024-09-10T22:50:01.718 INFO:teuthology.orchestra.run.smithi073.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 781 kB/s | 45 kB 00:00 2024-09-10T22:50:01.743 INFO:teuthology.orchestra.run.smithi073.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 435 kB/s | 171 kB 00:00 2024-09-10T22:50:01.768 INFO:teuthology.orchestra.run.smithi073.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-10T22:50:01.818 INFO:teuthology.orchestra.run.smithi073.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 851 kB/s | 42 kB 00:00 2024-09-10T22:50:01.821 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:50:01.869 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:50:01.869 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:50:01.876 INFO:teuthology.orchestra.run.smithi073.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 292 kB 00:00 2024-09-10T22:50:01.902 INFO:teuthology.orchestra.run.smithi073.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-10T22:50:01.928 INFO:teuthology.orchestra.run.smithi073.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 694 kB/s | 36 kB 00:00 2024-09-10T22:50:01.953 INFO:teuthology.orchestra.run.smithi073.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T22:50:01.987 INFO:teuthology.orchestra.run.smithi073.stdout:(23/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-09-10T22:50:02.054 INFO:teuthology.orchestra.run.smithi073.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 547 kB/s | 26 kB 00:00 2024-09-10T22:50:02.079 INFO:teuthology.orchestra.run.smithi073.stdout:(25/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.0 MB/s | 309 kB 00:00 2024-09-10T22:50:02.104 INFO:teuthology.orchestra.run.smithi073.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-10T22:50:02.129 INFO:teuthology.orchestra.run.smithi073.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T22:50:02.195 INFO:teuthology.orchestra.run.smithi073.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 2.9 MB/s | 191 kB 00:00 2024-09-10T22:50:02.272 INFO:teuthology.orchestra.run.smithi073.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-10T22:50:02.364 INFO:teuthology.orchestra.run.smithi073.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 9.4 MB/s | 1.6 MB 00:00 2024-09-10T22:50:02.531 INFO:teuthology.orchestra.run.smithi073.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-10T22:50:02.589 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:50:02.589 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:50:02.606 INFO:teuthology.orchestra.run.smithi073.stdout:(32/33): librados2-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 3.5 MB 00:00 2024-09-10T22:50:02.664 INFO:teuthology.orchestra.run.smithi073.stdout:(33/33): librbd1-19.3.0-4854.g8f219c47.el9.x86_ 11 MB/s | 3.2 MB 00:00 2024-09-10T22:50:02.669 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:50:02.669 INFO:teuthology.orchestra.run.smithi073.stdout:Total 19 MB/s | 62 MB 00:03 2024-09-10T22:50:02.892 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:50:02.936 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:50:02.936 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:50:03.652 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:50:03.652 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:50:04.251 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:50:04.356 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-10T22:50:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-10T22:50:04.423 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-10T22:50:04.454 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-10T22:50:04.494 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-10T22:50:04.699 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-10T22:50:04.770 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-10T22:50:05.171 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-10T22:50:05.283 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-10T22:50:05.311 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:50:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-10T22:50:05.397 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-10T22:50:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-10T22:50:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-10T22:50:05.495 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 8/35 2024-09-10T22:50:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-10T22:50:05.526 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-10T22:50:05.542 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-10T22:50:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-10T22:50:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-10T22:50:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 11/35 2024-09-10T22:50:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-10T22:50:05.778 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-10T22:50:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-10T22:50:05.853 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-10T22:50:05.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-10T22:50:05.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-10T22:50:06.028 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-10T22:50:06.072 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-10T22:50:06.149 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-10T22:50:06.185 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/35 2024-09-10T22:50:06.215 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-10T22:50:06.245 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-10T22:50:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-10T22:50:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-10T22:50:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-10T22:50:06.487 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-10T22:50:06.584 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 8/35 2024-09-10T22:50:06.608 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-10T22:50:06.700 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-10T22:50:06.707 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-10T22:50:06.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-10T22:50:06.752 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-10T22:50:06.786 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 11/35 2024-09-10T22:50:06.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-10T22:50:06.902 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-10T22:50:06.915 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-10T22:50:06.950 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 24/35 2024-09-10T22:50:06.986 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-10T22:50:06.999 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-10T22:50:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-10T22:50:07.193 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-10T22:50:07.237 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-10T22:50:07.280 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-10T22:50:07.317 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/35 2024-09-10T22:50:07.372 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-10T22:50:07.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-10T22:50:07.447 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-10T22:50:07.567 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-10T22:50:07.597 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-10T22:50:07.688 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-10T22:50:07.775 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 28/35 2024-09-10T22:50:07.806 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-10T22:50:07.808 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 29/35 2024-09-10T22:50:07.842 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-10T22:50:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-10T22:50:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 24/35 2024-09-10T22:50:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-10T22:50:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-10T22:50:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-10T22:50:08.735 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-10T22:50:08.819 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 28/35 2024-09-10T22:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 29/35 2024-09-10T22:50:10.482 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-10T22:50:10.522 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-10T22:50:11.241 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-10T22:50:11.293 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-10T22:50:11.422 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-10T22:50:11.422 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:50:11.423 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:50:11.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:11.445 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-10T22:50:11.452 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-10T22:50:11.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-10T22:50:12.178 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-10T22:50:12.230 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-10T22:50:12.369 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-10T22:50:12.369 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:50:12.370 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:50:12.370 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:12.414 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-10T22:50:23.289 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-10T22:50:23.289 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-09-10T22:50:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-10T22:50:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-10T22:50:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-10T22:50:24.473 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:24.473 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:50:24.473 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:50:24.473 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:50:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-10T22:50:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-10T22:50:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T22:50:24.601 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-10T22:50:24.652 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-10T22:50:24.653 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:24.653 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:50:24.653 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:50:24.653 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:50:24.653 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:24.657 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-10T22:50:24.778 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-10T22:50:24.779 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T22:50:26.054 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 1/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 3/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 4/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 5/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 6/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 8/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 9/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 10/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 11/35 2024-09-10T22:50:26.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 13/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-10T22:50:26.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-10T22:50:26.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-10T22:50:26.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-10T22:50:26.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-10T22:50:26.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-10T22:50:26.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-10T22:50:26.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-10T22:50:26.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-10T22:50:26.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-10T22:50:26.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 34/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 1/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 3/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 4/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 5/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 6/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-10T22:50:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 8/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 9/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 10/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 11/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 13/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-10T22:50:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-10T22:50:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-10T22:50:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-10T22:50:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-10T22:50:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-10T22:50:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-10T22:50:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 34/35 2024-09-10T22:50:26.787 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T22:50:26.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:50:26.788 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:26.790 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:50:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:50:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:50:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:50:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:50:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:50:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:50:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:50:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:50:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:26.969 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:50:27.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-test 2024-09-10T22:50:27.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2024-09-10T22:50:27.948 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:31 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:50:28.102 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:50:28.102 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:50:28.103 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-10T22:50:28.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:28.104 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 51 M 2024-09-10T22:50:28.104 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 217 M 2024-09-10T22:50:28.104 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:50:28.134 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:32 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:50:28.281 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:50:28.282 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:50:28.283 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:50:28.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:28.283 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:50:28.283 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:50:28.283 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-10T22:50:28.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:28.284 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 51 M 2024-09-10T22:50:28.284 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 217 M 2024-09-10T22:50:28.284 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:50:28.437 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-10T22:50:28.483 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-09-10T22:50:28.521 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 766 kB/s | 64 kB 00:00 2024-09-10T22:50:28.533 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-10T22:50:28.762 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): libcephsqlite-19.3.0-4854.g8f219c47.el9. 292 kB/s | 162 kB 00:00 2024-09-10T22:50:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): libcephsqlite-19.3.0-4854.g8f219c47.el9. 291 kB/s | 162 kB 00:00 2024-09-10T22:50:34.721 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): ceph-test-19.3.0-4854.g8f219c47.el9.x86_ 7.7 MB/s | 50 MB 00:06 2024-09-10T22:50:34.723 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:50:34.723 INFO:teuthology.orchestra.run.smithi046.stdout:Total 7.7 MB/s | 51 MB 00:06 2024-09-10T22:50:34.772 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:50:34.798 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:50:34.798 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:50:35.260 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:50:35.260 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:50:35.474 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): ceph-test-19.3.0-4854.g8f219c47.el9.x86_ 7.0 MB/s | 50 MB 00:07 2024-09-10T22:50:35.476 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:50:35.477 INFO:teuthology.orchestra.run.smithi073.stdout:Total 7.1 MB/s | 51 MB 00:07 2024-09-10T22:50:35.522 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:50:35.544 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:50:35.545 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:50:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:50:35.969 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T22:50:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:50:35.981 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:50:36.014 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T22:50:36.040 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-10T22:50:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:50:36.646 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T22:50:36.692 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T22:50:36.718 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-10T22:50:41.518 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-10T22:50:41.612 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-10T22:50:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-10T22:50:41.934 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-10T22:50:43.892 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-10T22:50:43.892 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 1/4 2024-09-10T22:50:43.892 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2/4 2024-09-10T22:50:43.892 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T22:50:44.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T22:50:44.164 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:44.164 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:50:44.164 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:44.164 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:44.164 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:50:44.165 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:50:44.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:44.165 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:50:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-10T22:50:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 1/4 2024-09-10T22:50:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2/4 2024-09-10T22:50:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T22:50:44.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph 2024-09-10T22:50:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T22:50:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:44.651 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:50:44.964 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2024-09-10T22:50:45.260 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:49 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:50:45.408 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:50:45.411 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:50:45.412 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:50:45.413 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout:Install 37 Packages 2024-09-10T22:50:45.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:45.415 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 31 M 2024-09-10T22:50:45.415 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 109 M 2024-09-10T22:50:45.415 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:50:45.730 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:49 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:50:45.880 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:50:45.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:50:45.884 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:50:45.885 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout:Install 37 Packages 2024-09-10T22:50:45.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:45.887 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 31 M 2024-09-10T22:50:45.887 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 109 M 2024-09-10T22:50:45.887 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:50:46.311 INFO:teuthology.orchestra.run.smithi046.stdout:(1/37): ceph-19.3.0-4854.g8f219c47.el9.x86_64.r 21 kB/s | 6.6 kB 00:00 2024-09-10T22:50:47.036 INFO:teuthology.orchestra.run.smithi073.stdout:(1/37): ceph-19.3.0-4854.g8f219c47.el9.x86_64.r 19 kB/s | 6.6 kB 00:00 2024-09-10T22:50:47.136 INFO:teuthology.orchestra.run.smithi046.stdout:(2/37): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86_ 1.3 MB/s | 1.5 MB 00:01 2024-09-10T22:50:47.528 INFO:teuthology.orchestra.run.smithi046.stdout:(3/37): ceph-mds-19.3.0-4854.g8f219c47.el9.x86_ 1.6 MB/s | 2.4 MB 00:01 2024-09-10T22:50:47.703 INFO:teuthology.orchestra.run.smithi046.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4854.g8f21 1.6 MB/s | 291 kB 00:00 2024-09-10T22:50:47.870 INFO:teuthology.orchestra.run.smithi046.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-10T22:50:47.987 INFO:teuthology.orchestra.run.smithi046.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-09-10T22:50:47.994 INFO:teuthology.orchestra.run.smithi073.stdout:(2/37): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86_ 1.2 MB/s | 1.5 MB 00:01 2024-09-10T22:50:48.038 INFO:teuthology.orchestra.run.smithi046.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T22:50:48.088 INFO:teuthology.orchestra.run.smithi046.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.7 MB/s | 135 kB 00:00 2024-09-10T22:50:48.138 INFO:teuthology.orchestra.run.smithi046.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-10T22:50:48.188 INFO:teuthology.orchestra.run.smithi046.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-10T22:50:48.303 INFO:teuthology.orchestra.run.smithi073.stdout:(3/37): ceph-mds-19.3.0-4854.g8f219c47.el9.x86_ 1.5 MB/s | 2.4 MB 00:01 2024-09-10T22:50:48.364 INFO:teuthology.orchestra.run.smithi046.stdout:(11/37): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 2.3 MB/s | 4.8 MB 00:02 2024-09-10T22:50:48.414 INFO:teuthology.orchestra.run.smithi046.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 838 kB/s | 188 kB 00:00 2024-09-10T22:50:48.478 INFO:teuthology.orchestra.run.smithi073.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4854.g8f21 1.6 MB/s | 291 kB 00:00 2024-09-10T22:50:48.506 INFO:teuthology.orchestra.run.smithi046.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 379 kB/s | 35 kB 00:00 2024-09-10T22:50:48.556 INFO:teuthology.orchestra.run.smithi046.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-10T22:50:48.581 INFO:teuthology.orchestra.run.smithi046.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 792 kB/s | 172 kB 00:00 2024-09-10T22:50:48.606 INFO:teuthology.orchestra.run.smithi073.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-10T22:50:48.632 INFO:teuthology.orchestra.run.smithi046.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-09-10T22:50:48.682 INFO:teuthology.orchestra.run.smithi046.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-10T22:50:48.698 INFO:teuthology.orchestra.run.smithi073.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-10T22:50:48.740 INFO:teuthology.orchestra.run.smithi073.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T22:50:48.741 INFO:teuthology.orchestra.run.smithi046.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-10T22:50:48.783 INFO:teuthology.orchestra.run.smithi073.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-10T22:50:48.784 INFO:teuthology.orchestra.run.smithi046.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 147 kB/s | 22 kB 00:00 2024-09-10T22:50:48.826 INFO:teuthology.orchestra.run.smithi046.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 512 kB/s | 43 kB 00:00 2024-09-10T22:50:48.855 INFO:teuthology.orchestra.run.smithi073.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.7 MB/s | 125 kB 00:00 2024-09-10T22:50:48.885 INFO:teuthology.orchestra.run.smithi046.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 7.4 MB/s | 358 kB 00:00 2024-09-10T22:50:48.900 INFO:teuthology.orchestra.run.smithi073.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.7 MB/s | 215 kB 00:00 2024-09-10T22:50:48.935 INFO:teuthology.orchestra.run.smithi046.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2024-09-10T22:50:48.942 INFO:teuthology.orchestra.run.smithi073.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-10T22:50:48.960 INFO:teuthology.orchestra.run.smithi046.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 978 kB/s | 172 kB 00:00 2024-09-10T22:50:48.984 INFO:teuthology.orchestra.run.smithi073.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 4.1 MB/s | 172 kB 00:00 2024-09-10T22:50:49.002 INFO:teuthology.orchestra.run.smithi046.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2024-09-10T22:50:49.026 INFO:teuthology.orchestra.run.smithi073.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 835 kB/s | 35 kB 00:00 2024-09-10T22:50:49.044 INFO:teuthology.orchestra.run.smithi046.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 276 kB/s | 23 kB 00:00 2024-09-10T22:50:49.068 INFO:teuthology.orchestra.run.smithi073.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-10T22:50:49.086 INFO:teuthology.orchestra.run.smithi046.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 233 kB/s | 19 kB 00:00 2024-09-10T22:50:49.110 INFO:teuthology.orchestra.run.smithi073.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T22:50:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 236 kB/s | 20 kB 00:00 2024-09-10T22:50:49.171 INFO:teuthology.orchestra.run.smithi046.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 554 kB/s | 46 kB 00:00 2024-09-10T22:50:49.196 INFO:teuthology.orchestra.run.smithi046.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-10T22:50:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:(16/37): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 2.2 MB/s | 4.8 MB 00:02 2024-09-10T22:50:49.235 INFO:teuthology.orchestra.run.smithi073.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 42 kB 00:00 2024-09-10T22:50:49.237 INFO:teuthology.orchestra.run.smithi046.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 397 kB/s | 16 kB 00:00 2024-09-10T22:50:49.263 INFO:teuthology.orchestra.run.smithi046.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.6 MB/s | 90 kB 00:00 2024-09-10T22:50:49.286 INFO:teuthology.orchestra.run.smithi073.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-10T22:50:49.297 INFO:teuthology.orchestra.run.smithi046.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-10T22:50:49.311 INFO:teuthology.orchestra.run.smithi073.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-10T22:50:49.336 INFO:teuthology.orchestra.run.smithi073.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 865 kB/s | 43 kB 00:00 2024-09-10T22:50:49.338 INFO:teuthology.orchestra.run.smithi046.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 476 kB/s | 36 kB 00:00 2024-09-10T22:50:49.372 INFO:teuthology.orchestra.run.smithi046.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T22:50:49.395 INFO:teuthology.orchestra.run.smithi073.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-10T22:50:49.414 INFO:teuthology.orchestra.run.smithi046.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 482 kB/s | 20 kB 00:00 2024-09-10T22:50:49.420 INFO:teuthology.orchestra.run.smithi073.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.8 MB/s | 358 kB 00:00 2024-09-10T22:50:49.445 INFO:teuthology.orchestra.run.smithi073.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-10T22:50:49.456 INFO:teuthology.orchestra.run.smithi046.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-10T22:50:49.470 INFO:teuthology.orchestra.run.smithi073.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2024-09-10T22:50:49.513 INFO:teuthology.orchestra.run.smithi073.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 347 kB/s | 23 kB 00:00 2024-09-10T22:50:49.538 INFO:teuthology.orchestra.run.smithi073.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 291 kB/s | 19 kB 00:00 2024-09-10T22:50:49.563 INFO:teuthology.orchestra.run.smithi073.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-10T22:50:49.588 INFO:teuthology.orchestra.run.smithi073.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-10T22:50:49.614 INFO:teuthology.orchestra.run.smithi073.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-10T22:50:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-10T22:50:49.664 INFO:teuthology.orchestra.run.smithi073.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.6 MB/s | 90 kB 00:00 2024-09-10T22:50:49.689 INFO:teuthology.orchestra.run.smithi073.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T22:50:49.707 INFO:teuthology.orchestra.run.smithi073.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 852 kB/s | 36 kB 00:00 2024-09-10T22:50:49.740 INFO:teuthology.orchestra.run.smithi073.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T22:50:49.757 INFO:teuthology.orchestra.run.smithi073.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-10T22:50:49.782 INFO:teuthology.orchestra.run.smithi073.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-10T22:50:51.464 INFO:teuthology.orchestra.run.smithi073.stdout:(37/37): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 4.9 MB/s | 17 MB 00:03 2024-09-10T22:50:51.469 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:50:51.469 INFO:teuthology.orchestra.run.smithi073.stdout:Total 5.5 MB/s | 31 MB 00:05 2024-09-10T22:50:51.754 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:50:51.802 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:50:51.802 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:50:52.319 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:50:52.319 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:50:52.698 INFO:teuthology.orchestra.run.smithi046.stdout:(37/37): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 3.1 MB/s | 17 MB 00:05 2024-09-10T22:50:52.703 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:50:52.703 INFO:teuthology.orchestra.run.smithi046.stdout:Total 4.2 MB/s | 31 MB 00:07 2024-09-10T22:50:52.989 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:50:53.042 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:50:53.042 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:50:53.578 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:50:53.578 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:50:53.863 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:50:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T22:50:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T22:50:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T22:50:54.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T22:50:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T22:50:54.230 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T22:50:54.333 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T22:50:54.443 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T22:50:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T22:50:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T22:50:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T22:50:54.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T22:50:54.640 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T22:50:54.701 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T22:50:54.752 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T22:50:54.784 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T22:50:54.836 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T22:50:54.874 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T22:50:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T22:50:55.059 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:50:55.118 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T22:50:55.153 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T22:50:55.171 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T22:50:55.207 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T22:50:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T22:50:55.300 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T22:50:55.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T22:50:55.347 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T22:50:55.387 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T22:50:55.400 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T22:50:55.461 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T22:50:55.506 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T22:50:55.526 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T22:50:55.603 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T22:50:55.651 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T22:50:55.692 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T22:50:55.737 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T22:50:55.757 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T22:50:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T22:50:55.812 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T22:50:55.813 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T22:50:55.864 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T22:50:55.897 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T22:50:55.917 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T22:50:55.948 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T22:50:55.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T22:50:56.001 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T22:50:56.039 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T22:50:56.046 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T22:50:56.134 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T22:50:56.208 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T22:50:56.323 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T22:50:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 32/37 2024-09-10T22:50:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-10T22:50:56.444 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T22:50:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-10T22:50:56.481 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:56.481 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:50:56.481 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:50:56.481 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:50:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:56.513 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T22:50:56.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T22:50:56.618 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T22:50:56.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T22:50:56.937 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T22:50:56.994 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T22:50:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T22:50:57.219 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T22:50:57.288 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T22:50:57.448 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T22:50:57.630 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 32/37 2024-09-10T22:50:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-10T22:50:57.727 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-10T22:50:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:50:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:50:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:50:57.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:58.045 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-10T22:50:58.102 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-10T22:50:58.102 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:58.103 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:50:58.103 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:50:58.103 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:50:58.103 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:58.595 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-10T22:50:58.646 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-10T22:50:58.647 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:58.647 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:50:58.647 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:50:58.647 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:50:58.647 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:58.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-10T22:50:58.946 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-10T22:50:58.947 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:58.947 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:50:58.947 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:50:58.947 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:50:58.947 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:59.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-10T22:50:59.126 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-10T22:50:59.127 INFO:teuthology.orchestra.run.smithi073.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T22:50:59.127 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:50:59.401 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-10T22:50:59.459 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-10T22:50:59.459 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:50:59.459 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:50:59.459 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:50:59.459 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:50:59.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:50:59.998 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-10T22:51:00.049 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-10T22:51:00.050 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:51:00.050 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:51:00.050 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:51:00.050 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:51:00.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:00.302 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-10T22:51:00.352 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-10T22:51:00.352 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:51:00.352 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:51:00.352 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:51:00.352 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:51:00.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:00.419 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-10T22:51:00.549 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-10T22:51:00.549 INFO:teuthology.orchestra.run.smithi046.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T22:51:00.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 3/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 4/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 5/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 6/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T22:51:00.931 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T22:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T22:51:00.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T22:51:00.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T22:51:00.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T22:51:00.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T22:51:00.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T22:51:00.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T22:51:00.934 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T22:51:00.934 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T22:51:00.934 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T22:51:00.934 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T22:51:00.934 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T22:51:00.934 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T22:51:00.935 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T22:51:00.935 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T22:51:00.935 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T22:51:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T22:51:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:01.824 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:51:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:51:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:01.827 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:02.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2024-09-10T22:51:02.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/37 2024-09-10T22:51:02.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2/37 2024-09-10T22:51:02.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 3/37 2024-09-10T22:51:02.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 4/37 2024-09-10T22:51:02.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 5/37 2024-09-10T22:51:02.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 6/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T22:51:02.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T22:51:02.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T22:51:02.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T22:51:02.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T22:51:02.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T22:51:02.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T22:51:02.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T22:51:02.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T22:51:02.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T22:51:02.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T22:51:02.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T22:51:02.990 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:06 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:03.088 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:03.130 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:03.131 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:03.131 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:03.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install cephadm 2024-09-10T22:51:03.347 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T22:51:03.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:51:03.348 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:51:03.349 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:51:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:03.351 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:03.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-base 2024-09-10T22:51:03.982 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:07 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:04.120 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:51:04.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:04.122 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 783 k 2024-09-10T22:51:04.122 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 790 k 2024-09-10T22:51:04.122 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:04.394 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm-19.3.0-4854.g8f219c47.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-10T22:51:04.395 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:04.396 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-10T22:51:04.396 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:04.402 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:04.402 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:04.409 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:04.409 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:04.503 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:08 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:04.603 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:04.649 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:04.650 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:51:04.650 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:04.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install cephadm 2024-09-10T22:51:05.034 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:05.519 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:09 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:51:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 783 k 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 790 k 2024-09-10T22:51:05.665 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:05.780 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:05.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:05.781 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:05.781 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:05.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:05.781 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:05.944 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm-19.3.0-4854.g8f219c47.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-10T22:51:05.945 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:05.945 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.7 MB/s | 783 kB 00:00 2024-09-10T22:51:05.945 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:05.952 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:05.952 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:05.959 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:05.960 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:06.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T22:51:06.065 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:06.746 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:06.849 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:10 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:06.878 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:06.998 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:07.000 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-10T22:51:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:07.000 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:51:07.000 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:07.001 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:07.001 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:51:07.001 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:07.001 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 145 k 2024-09-10T22:51:07.001 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 432 k 2024-09-10T22:51:07.001 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:07.194 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-19.3.0-4854.g8f219c 750 kB/s | 145 kB 00:00 2024-09-10T22:51:07.195 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:07.195 INFO:teuthology.orchestra.run.smithi073.stdout:Total 741 kB/s | 145 kB 00:00 2024-09-10T22:51:07.195 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:07.205 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:07.205 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:07.274 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:07.274 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:07.357 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:07.439 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:07.494 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-10T22:51:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-10T22:51:07.548 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:51:07.548 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:51:07.548 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:07.595 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:07.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:07.595 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:07.595 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:07.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:07.596 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:07.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T22:51:08.628 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:12 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:08.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-10T22:51:08.747 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:08.747 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:08.747 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:08.747 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:08.747 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:08.775 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:51:08.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:08.777 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 145 k 2024-09-10T22:51:08.777 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 432 k 2024-09-10T22:51:08.777 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:09.002 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-immutable-object-cache-19.3.0-4854.g8f219c 646 kB/s | 145 kB 00:00 2024-09-10T22:51:09.003 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:09.003 INFO:teuthology.orchestra.run.smithi046.stdout:Total 641 kB/s | 145 kB 00:00 2024-09-10T22:51:09.003 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:09.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2024-09-10T22:51:09.016 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:09.016 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:09.081 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:09.081 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:09.246 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:09.361 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-10T22:51:09.412 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-10T22:51:09.412 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:51:09.412 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:51:09.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:09.777 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:13 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:09.873 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:09.916 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:09.917 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:09.917 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:10.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T22:51:10.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-10T22:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:10.759 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:14 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:10.908 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:10.909 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:10.909 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:10.909 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:10.909 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:51:10.910 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 19 M 2024-09-10T22:51:10.911 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 159 M 2024-09-10T22:51:10.912 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:10.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr 2024-09-10T22:51:11.549 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4854.g8f2 107 kB/s | 16 kB 00:00 2024-09-10T22:51:11.575 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4854.g8f 191 kB/s | 34 kB 00:00 2024-09-10T22:51:11.700 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-10T22:51:11.714 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:15 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:11.741 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-10T22:51:11.813 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 7.5 MB/s | 863 kB 00:00 2024-09-10T22:51:11.817 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:11.865 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:11.866 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:51:11.866 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:11.867 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 373 kB/s | 19 kB 00:00 2024-09-10T22:51:11.909 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 3.2 MB/s | 548 kB 00:00 2024-09-10T22:51:11.943 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-10T22:51:11.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T22:51:11.968 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-10T22:51:12.010 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-10T22:51:12.069 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2024-09-10T22:51:12.244 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4854.g8f219c 17 MB/s | 14 MB 00:00 2024-09-10T22:51:12.248 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:12.249 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-10T22:51:12.328 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:12.351 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:12.351 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:12.639 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:12.640 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:12.723 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:16 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:12.871 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:51:12.872 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-09-10T22:51:12.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:12.874 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 19 M 2024-09-10T22:51:12.874 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 159 M 2024-09-10T22:51:12.874 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T22:51:13.398 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4854.g8f 195 kB/s | 34 kB 00:00 2024-09-10T22:51:13.440 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4854.g8f2 76 kB/s | 16 kB 00:00 2024-09-10T22:51:13.458 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T22:51:13.516 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T22:51:13.549 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T22:51:13.573 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-10T22:51:13.624 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-10T22:51:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T22:51:13.707 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2024-09-10T22:51:13.732 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 794 kB/s | 19 kB 00:00 2024-09-10T22:51:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T22:51:13.899 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 12 MB/s | 2.0 MB 00:00 2024-09-10T22:51:13.942 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T22:51:13.958 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.2 MB/s | 863 kB 00:00 2024-09-10T22:51:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T22:51:13.992 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.5 MB/s | 144 kB 00:00 2024-09-10T22:51:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T22:51:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 10/12 2024-09-10T22:51:14.151 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): ceph-mgr-dashboard-19.3.0-4854.g8f219c 15 MB/s | 14 MB 00:00 2024-09-10T22:51:14.176 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 142 kB/s | 31 kB 00:00 2024-09-10T22:51:14.201 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 913 kB/s | 188 kB 00:00 2024-09-10T22:51:14.205 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:14.205 INFO:teuthology.orchestra.run.smithi046.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-10T22:51:14.283 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:14.307 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:14.307 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:14.614 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:14.614 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:15.280 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:15.383 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T22:51:15.431 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T22:51:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T22:51:15.531 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T22:51:15.682 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T22:51:15.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T22:51:15.968 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T22:51:16.036 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T22:51:16.064 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T22:51:16.099 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 10/12 2024-09-10T22:51:17.663 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 11/12 2024-09-10T22:51:17.727 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-10T22:51:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-10T22:51:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 1/12 2024-09-10T22:51:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 2/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 3/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T22:51:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T22:51:19.897 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T22:51:19.897 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:19.897 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:19.897 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:51:19.897 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:19.897 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:51:19.898 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:51:19.899 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:19.899 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:19.979 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 11/12 2024-09-10T22:51:20.043 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-10T22:51:20.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T22:51:20.962 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:24 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:21.105 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:21.106 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-10T22:51:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:21.106 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-10T22:51:21.106 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:51:21.106 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:51:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:21.108 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 38 M 2024-09-10T22:51:21.109 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 212 M 2024-09-10T22:51:21.109 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:21.644 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-10T22:51:21.711 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-10T22:51:21.736 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-10T22:51:21.786 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-10T22:51:21.845 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 662 kB/s | 38 kB 00:00 2024-09-10T22:51:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-10T22:51:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 1/12 2024-09-10T22:51:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 2/12 2024-09-10T22:51:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 3/12 2024-09-10T22:51:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T22:51:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T22:51:22.003 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-10T22:51:22.070 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2024-09-10T22:51:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T22:51:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:22.189 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:51:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:22.190 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:22.235 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-09-10T22:51:22.271 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 917 kB/s | 245 kB 00:00 2024-09-10T22:51:22.296 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.1 MB/s | 250 kB 00:00 2024-09-10T22:51:22.371 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.4 MB/s | 4.9 MB 00:00 2024-09-10T22:51:22.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T22:51:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-10T22:51:22.689 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:22.690 INFO:teuthology.orchestra.run.smithi073.stdout:Total 24 MB/s | 38 MB 00:01 2024-09-10T22:51:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:23.201 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:23.201 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:23.247 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:27 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:23.393 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:51:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:23.395 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:23.396 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-10T22:51:23.396 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-09-10T22:51:23.396 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:23.396 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 38 M 2024-09-10T22:51:23.396 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 212 M 2024-09-10T22:51:23.396 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:23.673 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:23.673 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:23.676 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-10T22:51:23.735 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-10T22:51:23.760 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-10T22:51:23.802 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 439 kB/s | 18 kB 00:00 2024-09-10T22:51:23.844 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 928 kB/s | 38 kB 00:00 2024-09-10T22:51:23.953 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-09-10T22:51:24.003 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-10T22:51:24.103 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): ceph-mgr-diskprediction-local-19.3.0-48 13 MB/s | 7.4 MB 00:00 2024-09-10T22:51:24.178 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-10T22:51:24.271 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-10T22:51:24.337 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.0 MB/s | 250 kB 00:00 2024-09-10T22:51:24.514 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:24.574 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T22:51:24.586 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-10T22:51:24.587 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:24.587 INFO:teuthology.orchestra.run.smithi046.stdout:Total 32 MB/s | 38 MB 00:01 2024-09-10T22:51:24.623 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T22:51:24.739 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T22:51:24.780 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T22:51:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T22:51:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T22:51:25.069 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:25.103 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:25.103 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:25.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T22:51:25.602 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:25.603 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:25.953 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T22:51:26.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T22:51:26.464 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T22:51:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T22:51:26.726 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T22:51:26.772 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T22:51:27.022 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T22:51:27.054 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T22:51:27.158 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T22:51:27.661 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T22:51:28.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T22:51:28.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T22:51:28.830 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T22:51:28.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-10T22:51:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T22:51:31.029 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T22:51:31.060 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 1/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T22:51:31.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T22:51:31.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T22:51:31.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T22:51:31.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T22:51:31.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T22:51:31.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T22:51:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T22:51:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:51:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:51:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:31.774 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:32.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2024-09-10T22:51:32.973 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:33.113 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:33.115 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:33.115 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:33.115 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:33.115 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:33.115 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:51:33.116 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout:Install 13 Packages 2024-09-10T22:51:33.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:33.118 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 M 2024-09-10T22:51:33.118 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 26 M 2024-09-10T22:51:33.118 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:33.482 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-10T22:51:33.482 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 1/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T22:51:33.483 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T22:51:33.496 INFO:teuthology.orchestra.run.smithi073.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 203 kB/s | 19 kB 00:00 2024-09-10T22:51:33.521 INFO:teuthology.orchestra.run.smithi073.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 214 kB/s | 26 kB 00:00 2024-09-10T22:51:33.610 INFO:teuthology.orchestra.run.smithi073.stdout:(3/13): ceph-mgr-rook-19.3.0-4854.g8f219c47.el9 236 kB/s | 49 kB 00:00 2024-09-10T22:51:33.638 INFO:teuthology.orchestra.run.smithi073.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-10T22:51:33.689 INFO:teuthology.orchestra.run.smithi073.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 949 kB/s | 159 kB 00:00 2024-09-10T22:51:33.705 INFO:teuthology.orchestra.run.smithi073.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 803 kB/s | 54 kB 00:00 2024-09-10T22:51:33.747 INFO:teuthology.orchestra.run.smithi073.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 549 kB/s | 32 kB 00:00 2024-09-10T22:51:33.773 INFO:teuthology.orchestra.run.smithi073.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-10T22:51:33.798 INFO:teuthology.orchestra.run.smithi073.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.5 MB/s | 220 kB 00:00 2024-09-10T22:51:33.823 INFO:teuthology.orchestra.run.smithi073.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.3 MB/s | 279 kB 00:00 2024-09-10T22:51:33.848 INFO:teuthology.orchestra.run.smithi073.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:51:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:33.858 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:33.930 INFO:teuthology.orchestra.run.smithi073.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 6.5 MB/s | 1.0 MB 00:00 2024-09-10T22:51:33.965 INFO:teuthology.orchestra.run.smithi073.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 631 kB/s | 90 kB 00:00 2024-09-10T22:51:33.968 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:33.968 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-10T22:51:34.092 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:34.110 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:34.111 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:34.230 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:34.231 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:34.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-rook 2024-09-10T22:51:34.805 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:35.032 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T22:51:35.085 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:35.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T22:51:35.162 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T22:51:35.203 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T22:51:35.234 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:35.235 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:35.235 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:35.235 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:35.235 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:35.235 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:51:35.235 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:51:35.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout:Install 13 Packages 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.2 M 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 26 M 2024-09-10T22:51:35.237 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:35.271 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T22:51:35.385 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T22:51:35.523 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T22:51:35.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T22:51:35.637 INFO:teuthology.orchestra.run.smithi046.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 229 kB/s | 19 kB 00:00 2024-09-10T22:51:35.662 INFO:teuthology.orchestra.run.smithi046.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 235 kB/s | 26 kB 00:00 2024-09-10T22:51:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:(3/13): ceph-mgr-rook-19.3.0-4854.g8f219c47.el9 294 kB/s | 49 kB 00:00 2024-09-10T22:51:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-10T22:51:35.780 INFO:teuthology.orchestra.run.smithi046.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T22:51:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 802 kB/s | 54 kB 00:00 2024-09-10T22:51:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 426 kB/s | 32 kB 00:00 2024-09-10T22:51:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 217 kB/s | 14 kB 00:00 2024-09-10T22:51:35.914 INFO:teuthology.orchestra.run.smithi046.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.8 MB/s | 220 kB 00:00 2024-09-10T22:51:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-10T22:51:35.965 INFO:teuthology.orchestra.run.smithi046.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T22:51:36.049 INFO:teuthology.orchestra.run.smithi046.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-10T22:51:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 671 kB/s | 90 kB 00:00 2024-09-10T22:51:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-10T22:51:36.202 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:36.222 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:36.222 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:36.353 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:36.354 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T22:51:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T22:51:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T22:51:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T22:51:36.662 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-10T22:51:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:37.155 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T22:51:37.225 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T22:51:37.290 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T22:51:37.337 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T22:51:37.389 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T22:51:37.471 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-10T22:51:37.471 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 1/13 2024-09-10T22:51:37.471 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T22:51:37.471 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T22:51:37.472 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T22:51:37.519 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T22:51:37.655 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T22:51:37.726 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T22:51:37.826 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:51:37.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:51:37.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:51:37.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:51:37.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:51:37.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:51:37.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:37.828 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:38.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T22:51:38.669 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T22:51:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T22:51:38.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T22:51:38.813 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T22:51:38.845 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-10T22:51:38.933 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:39.078 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:51:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2024-09-10T22:51:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:39.081 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 7.0 M 2024-09-10T22:51:39.081 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 33 M 2024-09-10T22:51:39.081 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:39.453 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-10T22:51:39.536 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.5 MB/s | 548 kB 00:00 2024-09-10T22:51:39.586 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T22:51:39.687 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-10T22:51:39.712 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 595 kB/s | 74 kB 00:00 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 1/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T22:51:39.714 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T22:51:39.845 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): ceph-mgr-cephadm-19.3.0-4854.g8f219c47.e 291 kB/s | 154 kB 00:00 2024-09-10T22:51:39.847 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:39.847 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.2 MB/s | 7.0 MB 00:00 2024-09-10T22:51:39.940 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:39.954 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:39.954 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:51:40.071 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:40.072 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:40.079 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:40.080 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:40.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T22:51:40.430 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:40.623 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T22:51:40.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T22:51:41.135 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:45 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:41.283 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:41.283 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:41.283 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-09-10T22:51:41.285 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:41.285 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 7.0 M 2024-09-10T22:51:41.285 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 33 M 2024-09-10T22:51:41.285 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T22:51:41.418 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T22:51:41.501 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T22:51:41.534 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-10T22:51:41.910 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-10T22:51:41.986 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.2 MB/s | 548 kB 00:00 2024-09-10T22:51:42.010 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-10T22:51:42.036 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): ceph-mgr-cephadm-19.3.0-4854.g8f219c47.e 467 kB/s | 154 kB 00:00 2024-09-10T22:51:42.061 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-10T22:51:42.170 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-10T22:51:42.172 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:42.172 INFO:teuthology.orchestra.run.smithi046.stdout:Total 7.9 MB/s | 7.0 MB 00:00 2024-09-10T22:51:42.268 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:42.282 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:42.282 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:42.414 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:42.415 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:42.421 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-10T22:51:42.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/6 2024-09-10T22:51:42.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T22:51:42.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T22:51:42.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T22:51:42.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T22:51:42.726 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T22:51:42.726 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:42.726 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:42.726 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:42.726 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:51:42.726 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:51:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:51:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:51:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:51:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:42.747 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:42.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T22:51:43.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T22:51:43.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2024-09-10T22:51:43.677 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T22:51:43.773 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:43.787 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T22:51:43.871 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T22:51:43.901 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-10T22:51:43.915 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:43.916 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:43.916 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2024-09-10T22:51:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:43.918 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 980 k 2024-09-10T22:51:43.918 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 2.9 M 2024-09-10T22:51:43.918 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:44.098 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 622 kB/s | 80 kB 00:00 2024-09-10T22:51:44.256 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): ceph-fuse-19.3.0-4854.g8f219c47.el9.x86_ 3.1 MB/s | 900 kB 00:00 2024-09-10T22:51:44.257 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:44.257 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.8 MB/s | 980 kB 00:00 2024-09-10T22:51:44.279 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:44.312 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:44.312 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:44.407 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:44.407 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:44.799 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-10T22:51:44.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/6 2024-09-10T22:51:44.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T22:51:44.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T22:51:44.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T22:51:44.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T22:51:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T22:51:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-10T22:51:45.111 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T22:51:45.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:45.111 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:45.111 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:45.112 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:45.390 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-fuse 2024-09-10T22:51:45.760 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-10T22:51:45.760 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/2 2024-09-10T22:51:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T22:51:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:46.085 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T22:51:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:46.085 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:46.211 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:46.361 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:46.361 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 980 k 2024-09-10T22:51:46.362 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 2.9 M 2024-09-10T22:51:46.363 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:46.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-volume 2024-09-10T22:51:46.756 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-10T22:51:46.948 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): ceph-fuse-19.3.0-4854.g8f219c47.el9.x86_ 2.9 MB/s | 900 kB 00:00 2024-09-10T22:51:46.948 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:46.949 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.6 MB/s | 980 kB 00:00 2024-09-10T22:51:46.972 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:47.005 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:47.006 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:47.105 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:47.106 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:47.208 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:51 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:47.350 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:51:47.351 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:47.352 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 285 k 2024-09-10T22:51:47.352 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 1.3 M 2024-09-10T22:51:47.352 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T22:51:47.570 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-volume-19.3.0-4854.g8f219c47.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-10T22:51:47.570 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:47.571 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-10T22:51:47.571 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:47.581 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:47.581 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-10T22:51:47.637 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:47.637 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:47.897 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:47.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:48.031 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:48.031 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:51:48.032 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:51:48.032 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:48.376 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-10T22:51:48.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/2 2024-09-10T22:51:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T22:51:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:48.668 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:48.669 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T22:51:48.669 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:48.669 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:48.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-volume 2024-09-10T22:51:49.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:49.265 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:49.265 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:49.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:49.266 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:49.266 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:49.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2024-09-10T22:51:49.762 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:53 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:49.911 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:51:49.913 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:49.913 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 285 k 2024-09-10T22:51:49.913 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 1.3 M 2024-09-10T22:51:49.913 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:50.136 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-volume-19.3.0-4854.g8f219c47.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-10T22:51:50.136 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:50.137 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-10T22:51:50.137 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:50.148 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:50.148 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:50.187 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:50.188 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:50.335 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:54 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:50.454 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:50.474 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:51:50.475 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:50.476 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 127 k 2024-09-10T22:51:50.476 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 456 k 2024-09-10T22:51:50.476 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:50.521 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:50.557 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:50.557 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:51:50.557 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:51:50.557 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:50.668 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-19.3.0-4854.g8f219c47.el9.x86_64 664 kB/s | 127 kB 00:00 2024-09-10T22:51:50.668 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:50.669 INFO:teuthology.orchestra.run.smithi073.stdout:Total 657 kB/s | 127 kB 00:00 2024-09-10T22:51:50.669 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:50.675 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:50.675 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:50.761 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:50.761 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:50.926 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:51.057 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:51.572 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:51.736 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-10T22:51:51.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:51.736 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:51.736 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:51:51.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:51.736 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:51.874 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:51.874 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:51.874 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:51.874 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:51.874 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:51.874 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:52.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados-devel 2024-09-10T22:51:52.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2024-09-10T22:51:52.839 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:56 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:52.981 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:56 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:52.986 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:51:52.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:52.988 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 127 k 2024-09-10T22:51:52.988 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 456 k 2024-09-10T22:51:52.988 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:53.083 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:53.127 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:53.128 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:53.191 INFO:teuthology.orchestra.run.smithi046.stdout:librados-devel-19.3.0-4854.g8f219c47.el9.x86_64 626 kB/s | 127 kB 00:00 2024-09-10T22:51:53.192 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:53.192 INFO:teuthology.orchestra.run.smithi046.stdout:Total 620 kB/s | 127 kB 00:00 2024-09-10T22:51:53.192 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:53.199 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:53.199 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:53.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2024-09-10T22:51:53.290 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:53.291 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:53.474 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:53.583 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:53.958 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:57 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:54.097 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:54.097 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:54.097 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-10T22:51:54.097 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:54.098 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 32 k 2024-09-10T22:51:54.099 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 142 k 2024-09-10T22:51:54.099 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:51:54.116 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:54.263 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-19.3.0-4854.g8f219c47.el9.x86_6 193 kB/s | 32 kB 00:00 2024-09-10T22:51:54.264 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:54.264 INFO:teuthology.orchestra.run.smithi073.stdout:Total 191 kB/s | 32 kB 00:00 2024-09-10T22:51:54.265 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:51:54.269 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:51:54.269 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:51:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:51:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:51:54.372 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:51:54.391 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:54.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:54.391 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:54.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:54.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs2 2024-09-10T22:51:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:55.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:55.157 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:55.157 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:51:55.157 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:55.157 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:51:55.157 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:55.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2024-09-10T22:51:55.506 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:59 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:55.607 INFO:teuthology.orchestra.run.smithi046.stdout:Package libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:55.654 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:55.655 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:51:55.655 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:55.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs-devel 2024-09-10T22:51:56.148 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:00 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:56.246 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:56.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2024-09-10T22:51:56.508 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:00 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:56.654 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:56.654 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 32 k 2024-09-10T22:51:56.655 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 142 k 2024-09-10T22:51:56.656 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:51:56.810 INFO:teuthology.orchestra.run.smithi046.stdout:libcephfs-devel-19.3.0-4854.g8f219c47.el9.x86_6 205 kB/s | 32 kB 00:00 2024-09-10T22:51:56.811 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:51:56.811 INFO:teuthology.orchestra.run.smithi046.stdout:Total 203 kB/s | 32 kB 00:00 2024-09-10T22:51:56.811 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:51:56.816 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:51:56.816 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:51:56.836 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:51:56.836 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:51:56.933 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:51:57.052 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:57.119 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:01 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:57.216 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:57.261 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:57.262 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:57.262 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:57.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2024-09-10T22:51:57.499 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:57.742 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:51:57.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:57.742 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:51:57.742 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:51:57.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:51:57.742 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:57.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados2 2024-09-10T22:51:58.100 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:02 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:58.195 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:58.240 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:58.241 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:58.241 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:58.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2024-09-10T22:51:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:02 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:58.847 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:58.894 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:58.895 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:51:58.895 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:58.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librbd1 2024-09-10T22:51:59.065 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:03 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:59.163 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:59.208 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:51:59.209 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:51:59.209 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:51:59.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2024-09-10T22:51:59.764 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:03 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:51:59.864 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:51:59.912 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:51:59.913 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:51:59.914 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:51:59.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rados 2024-09-10T22:52:00.047 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:04 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:00.145 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:52:00.192 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:52:00.193 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:52:00.193 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:52:00.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2024-09-10T22:52:00.765 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:04 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:00.865 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:52:00.912 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:00.914 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:52:00.914 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:00.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rgw 2024-09-10T22:52:01.018 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:05 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:01.116 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:52:01.161 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:52:01.162 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-10T22:52:01.162 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:52:01.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2024-09-10T22:52:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:05 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:01.864 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:52:01.911 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:01.913 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:52:01.913 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:01.990 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:05 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:02.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-cephfs 2024-09-10T22:52:02.135 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:52:02.136 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-10T22:52:02.136 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:02.136 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:02.137 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 85 k 2024-09-10T22:52:02.138 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 231 k 2024-09-10T22:52:02.138 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:52:02.316 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-19.3.0-4854.g8f219c47.el9.x86_64.rpm 473 kB/s | 85 kB 00:00 2024-09-10T22:52:02.317 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:02.317 INFO:teuthology.orchestra.run.smithi073.stdout:Total 469 kB/s | 85 kB 00:00 2024-09-10T22:52:02.318 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:52:02.326 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:52:02.326 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:52:02.400 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:52:02.400 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:52:02.575 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:52:02.681 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:02.803 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:06 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:02.902 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:52:02.949 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:02.951 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:52:02.951 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:03.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rbd 2024-09-10T22:52:03.149 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:03.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:03.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:03.439 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:52:03.440 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:52:03.440 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:03.440 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:52:03.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2024-09-10T22:52:03.803 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:07 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:03.904 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-10T22:52:03.953 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:03.954 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-10T22:52:03.954 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:04.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-fuse 2024-09-10T22:52:04.494 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:08 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:04.641 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:52:04.641 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:04.641 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:52:04.642 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:04.643 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 3.2 M 2024-09-10T22:52:04.643 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 14 M 2024-09-10T22:52:04.643 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:52:04.820 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:08 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:04.970 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:04.971 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-10T22:52:04.971 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:04.971 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:52:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:52:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:04.972 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:52:04.972 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:04.972 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:52:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:04.972 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 85 k 2024-09-10T22:52:04.973 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 231 k 2024-09-10T22:52:04.973 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:52:04.987 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-19.3.0-4854.g8f219c47.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-10T22:52:04.988 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:04.988 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-10T22:52:04.989 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:52:04.999 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:52:04.999 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:52:05.091 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:52:05.092 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:52:05.181 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-fuse-19.3.0-4854.g8f219c47.el9.x86_64.rpm 407 kB/s | 85 kB 00:00 2024-09-10T22:52:05.181 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:05.182 INFO:teuthology.orchestra.run.smithi046.stdout:Total 403 kB/s | 85 kB 00:00 2024-09-10T22:52:05.182 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:52:05.191 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:52:05.191 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:52:05.266 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:52:05.267 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:52:05.442 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:52:05.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:52:05.646 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:05.697 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:52:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:52:05.698 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:52:05.698 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:52:05.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:06.079 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:06.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:06.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:06.382 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:52:06.383 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:52:06.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:06.383 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:06.676 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-mirror 2024-09-10T22:52:07.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:07.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:07.006 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:52:07.006 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:52:07.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:07.006 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:52:07.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2024-09-10T22:52:07.471 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:11 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:07.617 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:07.619 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 3.2 M 2024-09-10T22:52:07.620 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 14 M 2024-09-10T22:52:07.620 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:52:07.976 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-mirror-19.3.0-4854.g8f219c47.el9.x86_64.rpm 8.9 MB/s | 3.2 MB 00:00 2024-09-10T22:52:07.977 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:07.977 INFO:teuthology.orchestra.run.smithi046.stdout:Total 8.9 MB/s | 3.2 MB 00:00 2024-09-10T22:52:07.977 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:52:07.989 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:52:07.989 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:52:08.086 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:52:08.086 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:52:08.088 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:12 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:08.233 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T22:52:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T22:52:08.235 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-10T22:52:08.235 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:08.235 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 171 k 2024-09-10T22:52:08.235 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 490 k 2024-09-10T22:52:08.235 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T22:52:08.433 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-19.3.0-4854.g8f219c47.el9.x86_64.rpm 860 kB/s | 171 kB 00:00 2024-09-10T22:52:08.434 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:08.435 INFO:teuthology.orchestra.run.smithi073.stdout:Total 852 kB/s | 171 kB 00:00 2024-09-10T22:52:08.435 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T22:52:08.444 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T22:52:08.444 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T22:52:08.517 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T22:52:08.517 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T22:52:08.594 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:52:08.660 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T22:52:08.713 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:08.713 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:52:08.713 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:52:08.713 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:52:08.713 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:52:08.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:08.788 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:09.646 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:09.646 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T22:52:09.646 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:52:09.646 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:52:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T22:52:09.926 DEBUG:teuthology.parallel:result is None 2024-09-10T22:52:10.007 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:10.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:10.008 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:52:10.008 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:52:10.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:10.008 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:10.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-nbd 2024-09-10T22:52:11.111 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:15 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T22:52:11.262 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T22:52:11.263 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:11.263 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-10T22:52:11.263 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:11.263 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 171 k 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 490 k 2024-09-10T22:52:11.264 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T22:52:11.463 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-nbd-19.3.0-4854.g8f219c47.el9.x86_64.rpm 860 kB/s | 171 kB 00:00 2024-09-10T22:52:11.464 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:11.464 INFO:teuthology.orchestra.run.smithi046.stdout:Total 851 kB/s | 171 kB 00:00 2024-09-10T22:52:11.464 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T22:52:11.474 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T22:52:11.474 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T22:52:11.550 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T22:52:11.550 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T22:52:11.722 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T22:52:11.822 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:12.339 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:12.631 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-10T22:52:12.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T22:52:12.631 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:52:12.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:52:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T22:52:12.910 DEBUG:teuthology.parallel:result is None 2024-09-10T22:52:12.911 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:52:13.065 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:52:13.109 INFO:teuthology.orchestra.run.smithi046.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:52:13.110 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:52:13.110 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:52:13.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:52:13.266 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:52:13.316 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:52:13.316 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:52:13.317 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:52:13.318 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T22:52:13.319 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:52:13.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:52:13.375 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:52:13.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:52:13.437 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T22:52:13.437 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:52:13.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:52:13.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:52:13.587 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:52:13.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:52:13.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:52:13.745 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T22:52:13.745 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:52:13.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:52:13.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:52:13.897 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:52:13.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:52:13.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:52:14.049 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T22:52:14.049 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:52:14.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:52:14.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:52:14.201 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:52:14.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:52:14.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:52:14.352 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T22:52:14.448 INFO:tasks.cephadm:Config: {'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T22:52:14.449 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:52:14.449 INFO:tasks.cephadm:Cluster fsid is 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:52:14.449 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T22:52:14.449 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-10T22:52:14.450 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi046': '172.21.15.46', 'mon.smithi073': '172.21.15.73'} 2024-09-10T22:52:14.450 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T22:52:14.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-09-10T22:52:14.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-09-10T22:52:14.562 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T22:52:14.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:52:14.715 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T22:52:14.868 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:52:14.870 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T22:52:14.870 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T22:52:14.870 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:52:15.282 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:52 /home/ubuntu/cephtest/cephadm 2024-09-10T22:52:15.282 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:52:15.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:52 /home/ubuntu/cephtest/cephadm 2024-09-10T22:52:15.697 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:52:15.739 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:52:15.791 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T22:52:15.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:52:15.795 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:52:17.672 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:52:17.771 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:52:50.122 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T22:52:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:52:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:52:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-09-10T22:52:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:52:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T22:52:50.123 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T22:52:50.176 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-10T22:52:50.176 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:52:50.176 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:52:50.176 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-09-10T22:52:50.176 INFO:teuthology.orchestra.run.smithi046.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:52:50.177 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-10T22:52:50.177 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-10T22:52:50.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-09-10T22:52:50.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-09-10T22:52:50.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-09-10T22:52:50.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-09-10T22:52:50.434 INFO:tasks.cephadm:Writing seed config... 2024-09-10T22:52:50.435 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T22:52:50.435 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T22:52:50.435 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T22:52:50.435 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T22:52:50.436 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T22:52:50.437 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:52:50.437 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T22:52:50.471 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 52773b64-6fc7-11ef-bcea-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-10T22:52:50.472 DEBUG:teuthology.orchestra.run.smithi046:mon.smithi046> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service 2024-09-10T22:52:50.516 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T22:52:50.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:52:50.780 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:52:50.780 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2024-09-10T22:52:50.780 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T22:52:50.780 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2024-09-10T22:52:50.825 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-10T22:52:50.825 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2024-09-10T22:52:50.825 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2024-09-10T22:52:50.839 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T22:52:50.839 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T22:52:50.852 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T22:52:50.852 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-10T22:52:50.865 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-10T22:52:50.878 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-10T22:52:50.878 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-10T22:52:50.879 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2024-09-10T22:52:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-10T22:52:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T22:52:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2024-09-10T22:52:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2024-09-10T22:52:50.935 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T22:52:50.935 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T22:52:50.947 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T22:52:50.947 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-10T22:52:50.961 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-10T22:52:50.973 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-10T22:52:50.974 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-10T22:52:50.974 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2024-09-10T22:52:50.974 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:52:50.974 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 140713535007040 on /run/cephadm/52773b64-6fc7-11ef-bcea-c7b262605968.lock 2024-09-10T22:52:50.974 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 140713535007040 acquired on /run/cephadm/52773b64-6fc7-11ef-bcea-c7b262605968.lock 2024-09-10T22:52:50.975 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2024-09-10T22:52:50.975 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2024-09-10T22:52:50.975 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-10T22:52:50.982 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.46 metric 100 2024-09-10T22:52:50.982 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2024-09-10T22:52:50.988 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T22:52:50.988 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T22:52:50.988 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1779sec hoplimit 64 pref medium 2024-09-10T22:52:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T22:52:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T22:52:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T22:52:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T22:52:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-10T22:52:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T22:52:50.995 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-10T22:52:50.995 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-10T22:52:50.995 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T22:52:50.995 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T22:52:50.996 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T22:52:51.504 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T22:53:00.177 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T22:53:00.177 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T22:53:00.177 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T22:53:03.663 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2024-09-10T22:53:03.663 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2024-09-10T22:53:04.718 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQDQzeBmdpmnAxAAC8EMrVwTSVljZ3bMQWN4nA== 2024-09-10T22:53:06.340 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQDRzeBmGuFeBxAAs3PKobhoXl3RSIQtwdi7Kw== 2024-09-10T22:53:07.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQDSzeBmI/oKMxAAqaIgEd3XP35rdqejQop0EQ== 2024-09-10T22:53:07.420 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2024-09-10T22:53:08.876 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T22:53:08.876 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for smithi046 [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:53:08.877 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2024-09-10T22:53:09.781 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.smithi046 on 2024-09-10T22:53:10.095 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T22:53:10.316 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T22:53:10.570 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-52773b64-6fc7-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-52773b64-6fc7-11ef-bcea-c7b262605968.target. 2024-09-10T22:53:10.570 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-52773b64-6fc7-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-52773b64-6fc7-11ef-bcea-c7b262605968.target. 2024-09-10T22:53:10.904 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046 2024-09-10T22:53:10.904 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service: Unit ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service not loaded. 2024-09-10T22:53:11.173 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-52773b64-6fc7-11ef-bcea-c7b262605968.target.wants/ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service → /etc/systemd/system/ceph-52773b64-6fc7-11ef-bcea-c7b262605968@.service. 2024-09-10T22:53:11.796 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:11 smithi046 podman[27752]: 2024-09-10 22:53:11.734569909 +0000 UTC m=+0.339058602 container start c82b772bed886fb1d9955a84ff97299de513634143dc23379e990e88611ec0f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:53:11.796 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:11 smithi046 bash[27752]: c82b772bed886fb1d9955a84ff97299de513634143dc23379e990e88611ec0f4 2024-09-10T22:53:11.824 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:53:11.825 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-10T22:53:11.837 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:53:11.838 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-10T22:53:11.838 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-10T22:53:11.838 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T22:53:11.838 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2024-09-10T22:53:11.838 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2024-09-10T22:53:12.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:11 smithi046 ceph-mon[27771]: mkfs 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:12.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:11 smithi046 ceph-mon[27771]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-09-10T22:53:12.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:11 smithi046 systemd[1]: Started Ceph mon.smithi046 for 52773b64-6fc7-11ef-bcea-c7b262605968. 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: monmap epoch 1 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: last_changed 2024-09-10T22:53:07.825757+0000 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: created 2024-09-10T22:53:07.825757+0000 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: min_mon_release 19 (squid) 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: election_strategy: 1 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: fsmap 2024-09-10T22:53:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T22:53:13.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: mgrmap e1: no daemons active 2024-09-10T22:53:13.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:12 smithi046 ceph-mon[27771]: from='client.? 172.21.15.46:0/1253930993' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T22:53:13.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T22:53:13.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:13.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T22:53:13.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:13.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2024-09-10T22:53:13.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi046 (age 0.624894s) 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2024-09-10T22:53:13.107 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T22:53:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:13 smithi046 ceph-mon[27771]: from='client.? 172.21.15.46:0/2923602055' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T22:53:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:13 smithi046 ceph-mon[27771]: from='client.? 172.21.15.46:0/2923602055' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:14.198 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T22:53:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T22:53:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T22:53:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T22:53:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T22:53:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2024-09-10T22:53:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:14 smithi046 ceph-mon[27771]: from='client.? 172.21.15.46:0/3421493389' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:53:15.353 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2024-09-10T22:53:15.720 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:15 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T22:53:16.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:15 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046[27767]: 2024-09-10T22:53:15.718+0000 7fcab8800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:53:16.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:15 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046[27767]: 2024-09-10T22:53:15.718+0000 7fcab8800640 -1 mon.smithi046@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T22:53:16.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:15 smithi046 podman[28008]: 2024-09-10 22:53:15.944466338 +0000 UTC m=+0.342393030 container died c82b772bed886fb1d9955a84ff97299de513634143dc23379e990e88611ec0f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T22:53:16.483 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 podman[28008]: 2024-09-10 22:53:16.306461929 +0000 UTC m=+0.704388623 container cleanup c82b772bed886fb1d9955a84ff97299de513634143dc23379e990e88611ec0f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T22:53:16.483 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 bash[28008]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046 2024-09-10T22:53:16.735 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 podman[28021]: 2024-09-10 22:53:16.482515382 +0000 UTC m=+0.531525923 container remove c82b772bed886fb1d9955a84ff97299de513634143dc23379e990e88611ec0f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:53:17.048 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 systemd[1]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service: Deactivated successfully. 2024-09-10T22:53:17.048 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for 52773b64-6fc7-11ef-bcea-c7b262605968. 2024-09-10T22:53:17.048 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 systemd[1]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service: Consumed 1.233s CPU time. 2024-09-10T22:53:17.049 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:16 smithi046 systemd[1]: Starting Ceph mon.smithi046 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T22:53:17.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 podman[28110]: 2024-09-10 22:53:16.951699725 +0000 UTC m=+0.027348542 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:53:17.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 podman[28110]: 2024-09-10 22:53:17.050114046 +0000 UTC m=+0.125762862 container create dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:53:17.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 podman[28110]: 2024-09-10 22:53:17.236041744 +0000 UTC m=+0.311690582 container init dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T22:53:17.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 podman[28110]: 2024-09-10 22:53:17.242518078 +0000 UTC m=+0.318166902 container start dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T22:53:17.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: pidfile_write: ignore empty --pid-file 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: load: jerasure load: lrc 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: RocksDB version: 7.9.2 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Git sha 0 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: DB SUMMARY 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: DB Session ID: PW9ZZVVZGFQDBKKF0378 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: CURRENT file: CURRENT 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T22:53:17.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000009.log size: 90424 ; 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.error_if_exists: 0 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.create_if_missing: 0 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.paranoid_checks: 1 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.env: 0x55cdd12c7180 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.info_log: 0x55cdd48538c0 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T22:53:17.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.statistics: (nil) 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.use_fsync: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_log_file_size: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.allow_fallocate: 1 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.use_direct_reads: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.db_log_dir: 2024-09-10T22:53:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.wal_dir: 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.write_buffer_manager: 0x55cdd4857b80 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T22:53:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.unordered_write: 0 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.row_cache: None 2024-09-10T22:53:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.wal_filter: None 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.two_write_queues: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.wal_compression: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.atomic_flush: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.log_readahead_size: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T22:53:17.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_background_jobs: 2 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_background_compactions: -1 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_subcompactions: 1 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T22:53:17.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_open_files: -1 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_background_flushes: -1 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Compression algorithms supported: 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kZSTD supported: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kXpressCompression supported: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kBZip2Compression supported: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T22:53:17.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kLZ4Compression supported: 1 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kZlibCompression supported: 1 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: kSnappyCompression supported: 1 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000010 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.merge_operator: 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_filter: None 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T22:53:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cdd4853500) 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 4 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x55cdd4847610 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-09-10T22:53:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-09-10T22:53:17.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: bloomfilter 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 5 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_auto_readahead_size: 262144 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: prepopulate_block_cache: 0 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: initial_auto_readahead_size: 8192 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T22:53:17.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression: NoCompression 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.num_levels: 7 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T22:53:17.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T22:53:17.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T22:53:17.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T22:53:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.inplace_update_support: 0 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.bloom_locality: 0 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.max_successive_merges: 0 2024-09-10T22:53:17.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.ttl: 2592000 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.enable_blob_files: false 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.min_blob_size: 0 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T22:53:17.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 763d72b2-fbc1-455a-8c04-8e61191ed982 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726008797284957, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T22:53:17.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726008797286767, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 87078, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 263, "table_properties": {"data_size": 85225, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10341, "raw_average_key_size": 46, "raw_value_size": 79280, "raw_average_value_size": 357, "num_data_blocks": 11, "num_entries": 222, "num_filter_entries": 222, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726008797, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "763d72b2-fbc1-455a-8c04-8e61191ed982", "db_session_id": "PW9ZZVVZGFQDBKKF0378", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726008797286944, "job": 1, "event": "recovery_finished"} 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cdd4878e00 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: DB pointer 0x55cdd4978000 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:53:17.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 2/0 86.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 86.94 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:53:17.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 14.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 14.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache BinnedLRUCache@0x55cdd4847610#2 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T22:53:17.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???) e1 preinit fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).mds e1 new map 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).mds e1 print_map 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e1 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: btime 2024-09-10T22:53:11:794363+0000 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: -1 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: No filesystems configured 2024-09-10T22:53:17.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:53:17.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:53:17.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:53:17.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:53:17.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T22:53:17.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 bash[28110]: dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 2024-09-10T22:53:17.345 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 systemd[1]: Started Ceph mon.smithi046 for 52773b64-6fc7-11ef-bcea-c7b262605968. 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: monmap epoch 1 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: last_changed 2024-09-10T22:53:07.825757+0000 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: created 2024-09-10T22:53:07.825757+0000 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: min_mon_release 19 (squid) 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: election_strategy: 1 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: fsmap 2024-09-10T22:53:17.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T22:53:17.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:17 smithi046 ceph-mon[28128]: mgrmap e1: no daemons active 2024-09-10T22:53:18.484 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T22:53:18.508 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:53:18.509 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2024-09-10T22:53:18.509 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T22:53:18.510 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T22:53:18.510 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-10T22:53:18.854 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mgr.smithi046.eocvws 2024-09-10T22:53:18.854 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mgr.smithi046.eocvws.service: Unit ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mgr.smithi046.eocvws.service not loaded. 2024-09-10T22:53:19.089 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-52773b64-6fc7-11ef-bcea-c7b262605968.target.wants/ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mgr.smithi046.eocvws.service → /etc/systemd/system/ceph-52773b64-6fc7-11ef-bcea-c7b262605968@.service. 2024-09-10T22:53:19.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:18 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/764613413' entity='client.admin' 2024-09-10T22:53:19.883 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:53:19.883 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-10T22:53:19.896 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:53:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-10T22:53:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-10T22:53:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T22:53:19.914 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:53:19.914 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-10T22:53:19.928 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:53:19.929 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-10T22:53:19.929 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-10T22:53:19.929 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-10T22:53:19.929 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2024-09-10T22:53:19.929 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2024-09-10T22:53:20.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:20 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/543889938' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:53:21.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "52773b64-6fc7-11ef-bcea-c7b262605968", 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-10T22:53:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:53:21.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.119 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:53:11:794363+0000", 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:53:11.795297+0000", 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:53:21.121 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2024-09-10T22:53:23.974 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:23 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2757282983' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "52773b64-6fc7-11ef-bcea-c7b262605968", 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:53:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:24.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:53:24.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:53:24.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:53:24.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:53:24.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:53:24.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:53:24.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:53:11:794363+0000", 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:53:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:53:11.795297+0000", 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:53:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2024-09-10T22:53:26.556 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: Activating manager daemon smithi046.eocvws 2024-09-10T22:53:26.556 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: mgrmap e2: smithi046.eocvws(active, starting, since 0.00506685s) 2024-09-10T22:53:26.556 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr metadata", "who": "smithi046.eocvws", "id": "smithi046.eocvws"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: Manager daemon smithi046.eocvws is now available 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/trash_purge_schedule"} : dispatch 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:26.557 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:26 smithi046 ceph-mon[28128]: from='mgr.14100 172.21.15.46:0/2453665039' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:27.447 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:27 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/4289818395' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:53:27.447 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:27 smithi046 ceph-mon[28128]: mgrmap e3: smithi046.eocvws(active, since 1.01342s) 2024-09-10T22:53:27.481 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "52773b64-6fc7-11ef-bcea-c7b262605968", 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:27.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:53:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:53:27.487 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:53:11:794363+0000", 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:53:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:53:11.795297+0000", 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:53:27.490 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:53:27.490 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (3/15)... 2024-09-10T22:53:29.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:29 smithi046 ceph-mon[28128]: mgrmap e4: smithi046.eocvws(active, since 2s) 2024-09-10T22:53:30.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:30 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2300101119' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:53:30.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "52773b64-6fc7-11ef-bcea-c7b262605968", 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:53:30.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:53:30.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:53:30.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:30.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:53:30.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-10T22:53:30.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:30.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:53:30.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:30.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:53:30.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:53:30.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:53:30.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:53:30.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:53:30.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:53:11:794363+0000", 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:53:30.863 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:53:11.795297+0000", 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:53:30.864 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2024-09-10T22:53:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:31 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2320716015' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T22:53:32.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T22:53:32.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T22:53:32.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-10T22:53:32.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T22:53:32.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T22:53:32.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T22:53:32.420 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2024-09-10T22:53:33.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:33 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3590021149' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T22:53:34.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:34 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3590021149' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T22:53:34.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:34 smithi046 ceph-mon[28128]: mgrmap e5: smithi046.eocvws(active, since 7s) 2024-09-10T22:53:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:35 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/34338100' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T22:53:35.330 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:53:35.330 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T22:53:35.330 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:53:35.330 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.eocvws", 2024-09-10T22:53:35.330 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T22:53:35.331 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:53:35.331 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-10T22:53:35.331 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: Active manager daemon smithi046.eocvws restarted 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: Activating manager daemon smithi046.eocvws 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: mgrmap e6: smithi046.eocvws(active, starting, since 0.00390467s) 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr metadata", "who": "smithi046.eocvws", "id": "smithi046.eocvws"} : dispatch 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:53:39.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:53:39.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:53:39.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:39 smithi046 ceph-mon[28128]: Manager daemon smithi046.eocvws is now available 2024-09-10T22:53:41.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:53:41.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T22:53:41.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T22:53:41.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:53:41.093 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2024-09-10T22:53:41.093 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: Found migration_current of "None". Setting to last migration. 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:53:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:53:41.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/trash_purge_schedule"} : dispatch 2024-09-10T22:53:41.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T22:53:41.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: mgrmap e7: smithi046.eocvws(active, since 1.00707s) 2024-09-10T22:53:41.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:41 smithi046 ceph-mon[28128]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T22:53:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:42 smithi046 ceph-mon[28128]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:42 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:42 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:53:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:42 smithi046 ceph-mon[28128]: mgrmap e8: smithi046.eocvws(active, since 2s) 2024-09-10T22:53:43.733 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T22:53:43.734 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: [10/Sep/2024:22:53:42] ENGINE Bus STARTING 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: [10/Sep/2024:22:53:42] ENGINE Serving on http://172.21.15.46:8765 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: [10/Sep/2024:22:53:42] ENGINE Serving on https://172.21.15.46:7150 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: [10/Sep/2024:22:53:42] ENGINE Bus STARTED 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: [10/Sep/2024:22:53:42] ENGINE Error in HTTPServer.serve 2024-09-10T22:53:43.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:53:43.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-10T22:53:43.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:53:43.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-10T22:53:43.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:53:43.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:43 smithi046 ceph-mon[28128]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:46.031 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:45 smithi046 ceph-mon[28128]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:46.031 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:45 smithi046 ceph-mon[28128]: Generating ssh key... 2024-09-10T22:53:46.031 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:45 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:46.032 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:45 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:46.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvsVcqVr2hlr6u9rukJudPQdMETlI3uxOFhfC+pVU+vLNbZNrJohZ2MG8r1HyjLQ516Ch6StbNb8ZGpFbTAjPm8ivTdOeVVe9gKjePMtqQEbLE9v0adoZelcsSQ8w19i1OMGqkovR/VyzuDW21c1t6NV+HRhVlRLkXvJb4uGfuC3bHvurSIvDAsW7W8bG/HdLfSZ+slNjCziJxihXRX6vzVgyAYfOWSQoM5nKekdiMavdRgqz+L/9zkcVVxR81fovgzuveAL63vMClKYiCAeD1L+A0RHb2bjAlUXaPsD82lIsCDSO1xDnC6MyD3X/Z4A/7MAd3wW4Saes2ItAZaB6TJRTtajPdgP7z+082mIKmeDc+l0fqlGpDiHmyWHdMN/lpbeOdmiMiyyOdeGRXgjH9XGbaTlRFcFP8cAInMFigWDKq6wTDBV7d3SqdUXXwq4gqbccClRo3QngDK/NvEoOVu5aG1lDg9icWocwdBF1kp0OI/RMHu0clJ2FXb5B+Etk= ceph-52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:53:46.590 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:53:46.590 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T22:53:46.603 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2024-09-10T22:53:46.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:46 smithi046 ceph-mon[28128]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:47.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:47 smithi046 ceph-mon[28128]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:49.543 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:49 smithi046 ceph-mon[28128]: Deploying cephadm binary to smithi046 2024-09-10T22:53:52.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2024-09-10T22:53:52.581 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mon service with default placement... 2024-09-10T22:53:53.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:52 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:53.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:52 smithi046 ceph-mon[28128]: Added host smithi046 2024-09-10T22:53:53.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:52 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:53:54.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:54 smithi046 ceph-mon[28128]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:54.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:54 smithi046 ceph-mon[28128]: Saving service mon spec with placement count:5 2024-09-10T22:53:54.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:54 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:54.957 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T22:53:54.957 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mgr service with default placement... 2024-09-10T22:53:55.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:55 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:55.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:55 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:55.987 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:55 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:56.260 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T22:53:56.261 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying crash service with default placement... 2024-09-10T22:53:56.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:56 smithi046 ceph-mon[28128]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:56.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:56 smithi046 ceph-mon[28128]: Saving service mgr spec with placement count:2 2024-09-10T22:53:57.677 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-10T22:53:57.678 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying ceph-exporter service with default placement... 2024-09-10T22:53:58.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:58 smithi046 ceph-mon[28128]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:53:58.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:58 smithi046 ceph-mon[28128]: Saving service crash spec with placement * 2024-09-10T22:53:58.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:58 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:59.445 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:59 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:59.445 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:53:59 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:53:59.452 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-10T22:53:59.452 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying prometheus service with default placement... 2024-09-10T22:54:00.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:00 smithi046 ceph-mon[28128]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:00.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:00 smithi046 ceph-mon[28128]: Saving service ceph-exporter spec with placement * 2024-09-10T22:54:00.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:00 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:00.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:00 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:00.816 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-10T22:54:00.816 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying grafana service with default placement... 2024-09-10T22:54:01.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:01 smithi046 ceph-mon[28128]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:01.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:01 smithi046 ceph-mon[28128]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:01.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:01 smithi046 ceph-mon[28128]: Saving service prometheus spec with placement count:1 2024-09-10T22:54:02.769 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-10T22:54:02.769 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying node-exporter service with default placement... 2024-09-10T22:54:03.040 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:02 smithi046 ceph-mon[28128]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:03.040 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:02 smithi046 ceph-mon[28128]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:03.040 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:02 smithi046 ceph-mon[28128]: Saving service grafana spec with placement count:1 2024-09-10T22:54:03.041 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:02 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:04.096 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-10T22:54:04.096 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying alertmanager service with default placement... 2024-09-10T22:54:04.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:04 smithi046 ceph-mon[28128]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:04.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:04 smithi046 ceph-mon[28128]: Saving service node-exporter spec with placement * 2024-09-10T22:54:04.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:04 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:04.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:04 smithi046 ceph-mon[28128]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:05.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-10T22:54:06.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:05 smithi046 ceph-mon[28128]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:06.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:05 smithi046 ceph-mon[28128]: Saving service alertmanager spec with placement count:1 2024-09-10T22:54:06.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:05 smithi046 ceph-mon[28128]: from='mgr.14120 172.21.15.46:0/4165109772' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:07.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:07 smithi046 ceph-mon[28128]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:07.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:07 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2287359123' entity='client.admin' 2024-09-10T22:54:08.245 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2024-09-10T22:54:08.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:08 smithi046 ceph-mon[28128]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:08.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:08 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3181890359' entity='client.admin' 2024-09-10T22:54:10.001 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:09 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3095296167' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T22:54:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:10 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3095296167' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T22:54:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:10 smithi046 ceph-mon[28128]: mgrmap e9: smithi046.eocvws(active, since 30s) 2024-09-10T22:54:11.756 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:11 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2468542546' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T22:54:11.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:54:11.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T22:54:11.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:54:11.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.eocvws", 2024-09-10T22:54:11.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T22:54:11.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:54:11.764 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-10T22:54:11.764 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2024-09-10T22:54:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: Active manager daemon smithi046.eocvws restarted 2024-09-10T22:54:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: Activating manager daemon smithi046.eocvws 2024-09-10T22:54:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T22:54:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: mgrmap e10: smithi046.eocvws(active, starting, since 0.00368874s) 2024-09-10T22:54:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:54:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr metadata", "who": "smithi046.eocvws", "id": "smithi046.eocvws"} : dispatch 2024-09-10T22:54:16.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:54:16.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:54:16.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:54:16.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:15 smithi046 ceph-mon[28128]: Manager daemon smithi046.eocvws is now available 2024-09-10T22:54:17.233 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:16 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:54:17.233 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:16 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:54:17.233 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:16 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/trash_purge_schedule"} : dispatch 2024-09-10T22:54:17.233 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:16 smithi046 ceph-mon[28128]: mgrmap e11: smithi046.eocvws(active, since 1.00828s) 2024-09-10T22:54:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:54:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T22:54:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T22:54:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:54:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2024-09-10T22:54:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T22:54:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:17 smithi046 ceph-mon[28128]: [10/Sep/2024:22:54:17] ENGINE Bus STARTING 2024-09-10T22:54:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:17 smithi046 ceph-mon[28128]: [10/Sep/2024:22:54:17] ENGINE Serving on https://172.21.15.46:7150 2024-09-10T22:54:18.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:17 smithi046 ceph-mon[28128]: [10/Sep/2024:22:54:17] ENGINE Error in HTTPServer.serve 2024-09-10T22:54:18.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-10T22:54:18.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:54:18.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:54:18.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:54:18.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-10T22:54:18.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:54:18.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:54:18.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:54:18.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-10T22:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-10T22:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:54:18.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-10T22:54:18.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:54:18.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-10T22:54:18.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:54:19.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:18 smithi046 ceph-mon[28128]: [10/Sep/2024:22:54:17] ENGINE Serving on http://172.21.15.46:8765 2024-09-10T22:54:19.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:18 smithi046 ceph-mon[28128]: [10/Sep/2024:22:54:17] ENGINE Bus STARTED 2024-09-10T22:54:19.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:18 smithi046 ceph-mon[28128]: mgrmap e12: smithi046.eocvws(active, since 2s) 2024-09-10T22:54:19.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:18 smithi046 ceph-mon[28128]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:19.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:18 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:19.814 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUT9KTre7jq1+RZnTLOWTQbRRIEcowDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIyNTQxOVoXDTM0\nMDkxMTIyNTQxOVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjQ2MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA0YpV0wM+By36iTGIEab0dFYF4m7CO/26GHVD\np46lqBorjpY0BjCeWdOoL6mPlTBu3fRPONsfujOqSrUZ+sFQnVB+5ltJiqcLoPid\nGjWVWKcgATQuJatx7PUF7k4TrVgIZJv5NDhwHH5wuhyuZ5mx7egWe0Uts7ACgC0P\nquxQJa+64QYpgAARDnfeeqVwdDz3D7cXOPq98xmsl1ztrSGmyApe0nHc0SGJnz5e\n63oYQuU4ZXpMEXrBfNwtlguVgwqh7prIX2LYYLU8MjfkqZtuA7mfr3ZKSQ7ROEpn\nTYa/YAlht/xjumSUK8bHsYkakTmevDxIMzNZzqZzQSKWr+9SOxkUBItzaBQeVQQO\nuO40Hz2z/yvrMqqBcCBhuP7qsa+nM9EmxcFCuirfiFeybz1bu/3ezW8S1mMUHLcE\nck3VChRnKQlViHZem1tBC/FDhrFjjPVDGU/H79Tetnd9F7DWTwYVMKeAMdqzS1zq\nngDdDpdwirTmv5P+1jqbhlaaeJPsALBbIpJGY2WlWgP3hPDr4BNk9t9yZMztlxHd\nt254HuoY3d3ICJ4I2s/09sYSkbQLnZ/gRH6dpjLUUQIh1RIhzVFLUMYgGaLpW+ZM\nlFUpVek8WGqePJR4/bgmifnJ3g27mHEMKZz4kygOD57F4c/eh2D9FZsH21tZMY59\nJx1gf5kCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDQ2ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPLjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCF\ndsc8xHYgo2thSlvD1eFXBarkoGL6tS7V0Pp4ucNzfPkfmgYVJT970iT+zwvTDQJ9\nu8CGuPU1zLJeKEWO+3KKn5J7UzOwyqu3Xlj6rM64bl5msjUCo0/ohVAPh6unQLkP\nYUyEQSmiMYQhDgb5B1e+Dj51+rV0g9cdL8GKydD9ow/t8E9UF07tURaEyoh8Gsu5\n5vjm23jCwlKXBhSkxMB8C0EHHuZJ3ZG55PcYCWrDfN3reteeB6p+pGb/S6RkFEQE\nrLtjT7enPjVhEeU7UnOQegl0tT2KHpdWbTubd6Hn2RwLsVbNkWSY4VqqBfbX01e6\njzHfpMCtuEqHPOBNi7zWaW1PTm+GpdxdUIfWWe92z/2JJjsSi1eZplerumUMhmAy\n5ZMfhaLXHi2DDyC/+i4Jkt98aWRkQm2zWMV2p6siVxxfwnsoskJVK+xcx4NryO1R\nwYDSD4/aVEAXc/llT7uSVqxpMYUAhchRgln2uglj0UdYRJsiofDoOjytd+gRn5yY\nvbk6Ynb5C+4lxvKizjZESNW6BISWSCcDihKoSN4Gx00P6TCLsyVF+h/tyyx1sSSa\nrnD4dDUSE+3fBFY91iyDOlSXrTg3zgVi7TzTor+HWqCsigmInhxjRb0oDZsTv7GH\nWmqZpoM9NmDZlwdiZVwZ9Oj8LVi2cQT7v3H/gWS8jw==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA0YpV0wM+By36iTGIEab0dFYF4m7CO/26GHVDp46lqBorjpY0\nBjCeWdOoL6mPlTBu3fRPONsfujOqSrUZ+sFQnVB+5ltJiqcLoPidGjWVWKcgATQu\nJatx7PUF7k4TrVgIZJv5NDhwHH5wuhyuZ5mx7egWe0Uts7ACgC0PquxQJa+64QYp\ngAARDnfeeqVwdDz3D7cXOPq98xmsl1ztrSGmyApe0nHc0SGJnz5e63oYQuU4ZXpM\nEXrBfNwtlguVgwqh7prIX2LYYLU8MjfkqZtuA7mfr3ZKSQ7ROEpnTYa/YAlht/xj\numSUK8bHsYkakTmevDxIMzNZzqZzQSKWr+9SOxkUBItzaBQeVQQOuO40Hz2z/yvr\nMqqBcCBhuP7qsa+nM9EmxcFCuirfiFeybz1bu/3ezW8S1mMUHLcEck3VChRnKQlV\niHZem1tBC/FDhrFjjPVDGU/H79Tetnd9F7DWTwYVMKeAMdqzS1zqngDdDpdwirTm\nv5P+1jqbhlaaeJPsALBbIpJGY2WlWgP3hPDr4BNk9t9yZMztlxHdt254HuoY3d3I\nCJ4I2s/09sYSkbQLnZ/gRH6dpjLUUQIh1RIhzVFLUMYgGaLpW+ZMlFUpVek8WGqe\nPJR4/bgmifnJ3g27mHEMKZz4kygOD57F4c/eh2D9FZsH21tZMY59Jx1gf5kCAwEA\nAQKCAf8Xg53TZK8IkY2sMR5oZWfLLwZZtyWTmtQanXuHxuUVtRNHFzp+tXdBXyqj\nTuyPzuIR91sUUNmzbvOH7+sVw9T7BpEyD1v9KUzuF/qarkNjtuYtleGmwOsM7Olw\nbDw2aViWrp+VmJMGHk+PlZR9/NfBksijiPWVfJXSthGPw0ScJUaBZOURnWySK55W\n+s7pYa1pVq20TtJ25TP/PTLFyyFDLrx8yFkxBeb0bKL8GV37k6SlLnebdJrv68pc\nESJt/QaSZp97nXu3E/Z2rrOvyaEcjkDFmi6jC6M1suMn61+EijvuSVV8y+p4zW/g\n+yXL4yU3lwX875cOCXgA6xdtuEDMcoTf8yz4AV7ZJ/NcGKZLsOZIFvyDQqjtxBfD\nwBPdDn+jZqg9N+VwSXq6o1ENXqB8Cwx1UjLVt0laR/4LF7bJqmTcpVDF1/O3PK6k\nxaECbVAyzBkopsr3Go3tmm+gSir+FwkMs4rO1Wr4ZYoGZ0ZpZbvtzFStdMpFCkVW\nBT7JVdjN+v7mfN+c0jK8e4/ZuPaEMNDxdl2TDaTS5lyr5oTSLNIWK4/CYZaZFULi\nv3XmV3g8Yk9T9vTQ/LRkRUNI73LWOPhh/r/I7xdzOjHTR0RG3xRVwzrSjrxPhz7O\nY3p1SsH/NscJi7GijspHAKSMgSgEaDZ3GnL1piYH3SLnHOhRAoIBAQDzxq1o1B6b\nkutUV0UAZiCEIWWyYUBgT6vGDuvx4Z5kMu36NzJ6zbBSDOwPFBM7Z0dl/4gRMz5m\n3znoscJDHs49bNgIomprKBJ4ovqG7JsXCWSUGXPobDGAl3+jy1QPSOT9dAEOppTt\nRGhplAMjoJvrADiBfQsE45L2GjwkZwi/QcJEa0WBm48GkmXhzpDPh3Sy92lfWLBN\nF/Sg6Q4S+hEDh5FTx65azoGTtBePUW0iWENiP/NgYlyqyVGqVTTMPOc0uGdUIkXx\ntT4fPSUl/5HqoTeGTj52kGtYQfpDdjwH9OUm+47U0ZF9NW3sohokjiXp2QShZByg\nPWtfkAi00KFNAoIBAQDcDC2rClbpXacXmObWGkUOFt3UrKJQLt7AeqDEutiQ0HLb\ne9Ks+6+JAcqP2L/17wGy9VzkQxTllSwLGNuqw+5QH7+8EatKZibolnrPeEXb/xte\nbqUJqQrzxI0P86KEVAxJyXgxuhTzCNCIMNjNU0quQQfmLSTwE2jxpq/Z90xgXhL4\n1WnuFiqUq3IW2fAJ4PMijBxdVqFeDTwBrzPdu6Bq16PqUGcO0RJHoUTf6+ggcmxq\nP/7ncVIq+yneulpVKPDUJjfKiE8ecuDiMOEmTBiWYXyJBf+qdG5IKhSpUpN1L+yO\nAAEExeIYkP67KDXgHtRxMsl3EofI2kfYvRsmKjF9AoIBAQCFfOLSR21nRYFl0s/v\nEv11PRCCKGznEFmAgAVFk4V3Wsgjvvv+cQm/NGJDM3wAiGJ5gP7SZFwkWtJMEKLO\nvFy1GBgISl+5w9yxgJVtMr0OVU9lJbbpq+1DfDIh0CJ8qC70dwRpMGDWuCHwxmMd\nrEIU4i8PARj6mV+NMfqC+IS6rlihvJf4C+W69Imjp8h2S7dklMR3uIn5/Ucwoc3a\nKGMOqrqyxOI9yVz9M52/FhiLuQdVEq3DtrkFsG3utu/NcwAsR1oVoRrp65RT6Nih\nwRv2/kb4XXoo1JZjYuWW8XSX6stcmF2zPfrMNGi4Ll/gapJqRjMZ6Ucfm+JjFu0d\njiz1AoIBAQCxzVldWkZt3JG2XIMxPxrLTqjCPxgMSEMPLkcXj46MPRKBzOSnh9sH\njp35a394nj42N1Ju0tFgzQ9AjD57FkRLE8xej7xjqnUH/QeQ+rMgF1srC6ZpTuEd\npZUB7bBE0pD3Uka/j4d79YRid23HQuUWNk/GqnWtU1G56SEws0VQnNMho3grvFd9\nt6bBVipCITT0llgZB3XuRC1XgxUato/hpQq6u2r6qu7lWCcJ9FmlVi/KDpnOs19c\ngYQMh3GUXDd0hMkR6uBbTyHtQue6hURcxrrVETbLqbausuntA19JEodHGjO4gpi1\nlvttiQk3ZlHsgcgOYbe8ELx7Ihp81R0VAoIBAEeXGrwlt7dKqQjXz5HPEwgi400j\nUFcd3rSmq9AFn9LBEq3YyuTqhq9ZFvwcrL17nB/XDs/j/5u4Z8iB1+DcPh7mAGgj\noE6SFcxuYboyqFWJxIZvcXwQ4JouXEMMbbDdnLvAd5MGsqReZ3zgZt62tMR0HsWK\nYzCCTtjNC8WqfM+HFwxyL1yjiYLvaNs7fyGnpvP18lt8InAOwjGc+gB42xQsVfaE\nj4CLhlzPUw+kgPBKeq3DWVhYkJ1nK9dmYW5knUxTlvbLnzvl2sbLyGZWIoHLw33D\nHNXbT4XcFAtkTBLK+G27VW7G1ou+oddhcVR6FHmwTO6xw/TGdUubcdQ6d7Q=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T22:54:21.305 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:20 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:21.305 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:20 smithi046 ceph-mon[28128]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:21.305 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:20 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:21.309 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T22:54:23.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T22:54:23.113 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2024-09-10T22:54:23.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:23 smithi046 ceph-mon[28128]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:23.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:23 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:24.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OMDggJdinA3StH24EpB2q.84eb28MiS4mC0i7kGVwN3tk64u0W7Om", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726008864, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T22:54:24.610 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2024-09-10T22:54:25.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:25 smithi046 ceph-mon[28128]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:25.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:25 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:25.907 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T22:54:25.926 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:54:25.926 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-10T22:54:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:54:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-10T22:54:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-10T22:54:25.940 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T22:54:25.942 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2024-09-10T22:54:25.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:25.942 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2024-09-10T22:54:25.943 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2024-09-10T22:54:25.943 INFO:teuthology.orchestra.run.smithi046.stdout: Password: uxcuyb83t6 2024-09-10T22:54:25.943 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:25.943 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config directory 2024-09-10T22:54:26.159 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:26 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1015963733' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T22:54:27.413 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T22:54:27.413 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T22:54:27.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.414 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2024-09-10T22:54:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T22:54:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:27.415 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2024-09-10T22:54:27.471 INFO:tasks.cephadm:Fetching config... 2024-09-10T22:54:27.472 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:54:27.472 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T22:54:27.507 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T22:54:27.508 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:54:27.508 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T22:54:27.584 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T22:54:27.584 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:54:27.584 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/keyring of=/dev/stdout 2024-09-10T22:54:27.681 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T22:54:27.681 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:54:27.681 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T22:54:27.758 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T22:54:27.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvsVcqVr2hlr6u9rukJudPQdMETlI3uxOFhfC+pVU+vLNbZNrJohZ2MG8r1HyjLQ516Ch6StbNb8ZGpFbTAjPm8ivTdOeVVe9gKjePMtqQEbLE9v0adoZelcsSQ8w19i1OMGqkovR/VyzuDW21c1t6NV+HRhVlRLkXvJb4uGfuC3bHvurSIvDAsW7W8bG/HdLfSZ+slNjCziJxihXRX6vzVgyAYfOWSQoM5nKekdiMavdRgqz+L/9zkcVVxR81fovgzuveAL63vMClKYiCAeD1L+A0RHb2bjAlUXaPsD82lIsCDSO1xDnC6MyD3X/Z4A/7MAd3wW4Saes2ItAZaB6TJRTtajPdgP7z+082mIKmeDc+l0fqlGpDiHmyWHdMN/lpbeOdmiMiyyOdeGRXgjH9XGbaTlRFcFP8cAInMFigWDKq6wTDBV7d3SqdUXXwq4gqbccClRo3QngDK/NvEoOVu5aG1lDg9icWocwdBF1kp0OI/RMHu0clJ2FXb5B+Etk= ceph-52773b64-6fc7-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:54:27.900 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvsVcqVr2hlr6u9rukJudPQdMETlI3uxOFhfC+pVU+vLNbZNrJohZ2MG8r1HyjLQ516Ch6StbNb8ZGpFbTAjPm8ivTdOeVVe9gKjePMtqQEbLE9v0adoZelcsSQ8w19i1OMGqkovR/VyzuDW21c1t6NV+HRhVlRLkXvJb4uGfuC3bHvurSIvDAsW7W8bG/HdLfSZ+slNjCziJxihXRX6vzVgyAYfOWSQoM5nKekdiMavdRgqz+L/9zkcVVxR81fovgzuveAL63vMClKYiCAeD1L+A0RHb2bjAlUXaPsD82lIsCDSO1xDnC6MyD3X/Z4A/7MAd3wW4Saes2ItAZaB6TJRTtajPdgP7z+082mIKmeDc+l0fqlGpDiHmyWHdMN/lpbeOdmiMiyyOdeGRXgjH9XGbaTlRFcFP8cAInMFigWDKq6wTDBV7d3SqdUXXwq4gqbccClRo3QngDK/NvEoOVu5aG1lDg9icWocwdBF1kp0OI/RMHu0clJ2FXb5B+Etk= ceph-52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:54:27.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:27 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2849917543' entity='client.admin' 2024-09-10T22:54:27.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvsVcqVr2hlr6u9rukJudPQdMETlI3uxOFhfC+pVU+vLNbZNrJohZ2MG8r1HyjLQ516Ch6StbNb8ZGpFbTAjPm8ivTdOeVVe9gKjePMtqQEbLE9v0adoZelcsSQ8w19i1OMGqkovR/VyzuDW21c1t6NV+HRhVlRLkXvJb4uGfuC3bHvurSIvDAsW7W8bG/HdLfSZ+slNjCziJxihXRX6vzVgyAYfOWSQoM5nKekdiMavdRgqz+L/9zkcVVxR81fovgzuveAL63vMClKYiCAeD1L+A0RHb2bjAlUXaPsD82lIsCDSO1xDnC6MyD3X/Z4A/7MAd3wW4Saes2ItAZaB6TJRTtajPdgP7z+082mIKmeDc+l0fqlGpDiHmyWHdMN/lpbeOdmiMiyyOdeGRXgjH9XGbaTlRFcFP8cAInMFigWDKq6wTDBV7d3SqdUXXwq4gqbccClRo3QngDK/NvEoOVu5aG1lDg9icWocwdBF1kp0OI/RMHu0clJ2FXb5B+Etk= ceph-52773b64-6fc7-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:54:28.021 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvsVcqVr2hlr6u9rukJudPQdMETlI3uxOFhfC+pVU+vLNbZNrJohZ2MG8r1HyjLQ516Ch6StbNb8ZGpFbTAjPm8ivTdOeVVe9gKjePMtqQEbLE9v0adoZelcsSQ8w19i1OMGqkovR/VyzuDW21c1t6NV+HRhVlRLkXvJb4uGfuC3bHvurSIvDAsW7W8bG/HdLfSZ+slNjCziJxihXRX6vzVgyAYfOWSQoM5nKekdiMavdRgqz+L/9zkcVVxR81fovgzuveAL63vMClKYiCAeD1L+A0RHb2bjAlUXaPsD82lIsCDSO1xDnC6MyD3X/Z4A/7MAd3wW4Saes2ItAZaB6TJRTtajPdgP7z+082mIKmeDc+l0fqlGpDiHmyWHdMN/lpbeOdmiMiyyOdeGRXgjH9XGbaTlRFcFP8cAInMFigWDKq6wTDBV7d3SqdUXXwq4gqbccClRo3QngDK/NvEoOVu5aG1lDg9icWocwdBF1kp0OI/RMHu0clJ2FXb5B+Etk= ceph-52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:54:28.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T22:54:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:54:30.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:29 smithi046 ceph-mon[28128]: mgrmap e13: smithi046.eocvws(active, since 12s) 2024-09-10T22:54:30.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:29 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/666585397' entity='client.admin' 2024-09-10T22:54:30.424 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T22:54:30.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T22:54:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"} : dispatch 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:54:32.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:32 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:54:33.201 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi073 2024-09-10T22:54:33.201 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:54:33.201 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.conf 2024-09-10T22:54:33.240 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:54:33.240 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:54:33.317 INFO:tasks.cephadm:Adding host smithi073 to orchestrator... 2024-09-10T22:54:33.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch host add smithi073 2024-09-10T22:54:33.695 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:54:34.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:33 smithi046 ceph-mon[28128]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: Updating smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T22:54:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:34 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:54:36.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:35 smithi046 ceph-mon[28128]: Updating smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:54:36.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:35 smithi046 ceph-mon[28128]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:36.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:35 smithi046 ceph-mon[28128]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-09-10T22:54:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:37 smithi046 ceph-mon[28128]: Deploying cephadm binary to smithi073 2024-09-10T22:54:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:37 smithi046 ceph-mon[28128]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:39.077 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi073' with addr '172.21.15.73' 2024-09-10T22:54:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:39.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:39.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:54:39.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T22:54:39.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:54:39.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:39 smithi046 ceph-mon[28128]: Deploying daemon crash.smithi046 on smithi046 2024-09-10T22:54:39.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T22:54:40.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:40 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:40.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:40 smithi046 ceph-mon[28128]: Added host smithi073 2024-09-10T22:54:40.410 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:54:41.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:41 smithi046 ceph-mon[28128]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:41.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:54:41.367 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}] 2024-09-10T22:54:42.314 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T22:54:42.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T22:54:42.536 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:42 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:42.536 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:42 smithi046 ceph-mon[28128]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:54:42.536 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:42 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:42.536 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:42 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:42.536 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:42 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:42.536 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:42 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:54:43.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:43 smithi046 ceph-mon[28128]: Deploying daemon node-exporter.smithi046 on smithi046 2024-09-10T22:54:43.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:43 smithi046 ceph-mon[28128]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:44.364 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-09-10T22:54:44.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:44 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/119013331' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T22:54:45.644 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:45 smithi046 ceph-mon[28128]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:45.645 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:45 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/119013331' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T22:54:45.645 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:45 smithi046 ceph-mon[28128]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:54:45.676 INFO:tasks.cephadm:Adding mon.smithi046 on smithi046 2024-09-10T22:54:45.676 INFO:tasks.cephadm:Adding mon.smithi073 on smithi073 2024-09-10T22:54:45.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch apply mon '2;smithi046:172.21.15.46=smithi046;smithi073:172.21.15.73=smithi073' 2024-09-10T22:54:46.063 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:46.148 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:46.904 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mon update... 2024-09-10T22:54:47.554 DEBUG:teuthology.orchestra.run.smithi073:mon.smithi073> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi073.service 2024-09-10T22:54:47.558 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:54:47.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:47.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:47 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:47.944 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:48.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:54:48.789 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:54:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:54:48.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:48 smithi046 ceph-mon[28128]: Deploying daemon alertmanager.smithi046 on smithi046 2024-09-10T22:54:48.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:48 smithi046 ceph-mon[28128]: from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi073:172.21.15.73=smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:54:48.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:48 smithi046 ceph-mon[28128]: Saving service mon spec with placement smithi046:172.21.15.46=smithi046;smithi073:172.21.15.73=smithi073;count:2 2024-09-10T22:54:49.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:49 smithi046 ceph-mon[28128]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:49.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:49 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1990993140' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:54:50.729 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:54:50.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:54:51.100 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:51.186 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:51.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:51 smithi046 ceph-mon[28128]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:51.996 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:54:51.996 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:54:51.996 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:54:52.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:52 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:52.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:52 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1486844870' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:54:53.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:53 smithi046 ceph-mon[28128]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:53.651 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:54:53.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:54:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:54.107 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:54:54.911 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:54:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:54:55.622 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:55 smithi046 ceph-mon[28128]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:55.622 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:55 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1860248615' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:54:56.573 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:54:56.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:54:56.927 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:57 smithi046 ceph-mon[28128]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:54:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:57 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:57 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:57 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:57 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:57 smithi046 ceph-mon[28128]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-10T22:54:57.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:54:57.829 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:54:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:54:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: Deploying daemon grafana.smithi046 on smithi046 2024-09-10T22:54:59.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:58 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3411364451' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:54:59.532 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:54:59.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:54:59.887 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:54:59.972 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:00.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:54:59 smithi046 ceph-mon[28128]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:00.858 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:02.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:01 smithi046 ceph-mon[28128]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:02.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:01 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/764326646' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:02.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:01 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:02.522 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:02.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:02.969 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:03.758 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:03.758 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:04.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:03 smithi046 ceph-mon[28128]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:04 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1580668388' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:05.408 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:05.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:05.778 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:06.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:05 smithi046 ceph-mon[28128]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:06.749 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:06.749 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:06.749 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:08.004 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:07 smithi046 ceph-mon[28128]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:08.005 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:07 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3661544937' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:08.484 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:08.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:09.763 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:09.763 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:09.763 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:09.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:09 smithi046 ceph-mon[28128]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:11.036 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:10 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3426077936' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:11.466 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:11.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:11 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:11.823 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:11.908 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:12.723 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:12.723 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:12.724 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:12.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:12 smithi046 ceph-mon[28128]: Deploying daemon prometheus.smithi046 on smithi046 2024-09-10T22:55:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:13 smithi046 ceph-mon[28128]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:13 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2389647818' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:14.381 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:14.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:14.826 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:15.632 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:15.633 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:16.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:15 smithi046 ceph-mon[28128]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:16.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:15 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2074344251' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:17.327 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:17.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:17.679 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:17.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:17 smithi046 ceph-mon[28128]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:18.680 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:19.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:18 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1569698023' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:19.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:19 smithi046 ceph-mon[28128]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:20.309 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:20.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:20.685 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:20.775 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:21.565 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:21.566 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:22.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:21 smithi046 ceph-mon[28128]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:22.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:21 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2980818914' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:23.255 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:23.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:23.618 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:23.703 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:23.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:23 smithi046 ceph-mon[28128]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:23.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:23 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:23.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:23 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:23.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:23 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:23.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:23 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-10T22:55:24.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:24.633 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:26.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:25 smithi046 ceph-mon[28128]: from='mgr.14164 172.21.15.46:0/2519226020' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T22:55:26.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:25 smithi046 ceph-mon[28128]: mgrmap e14: smithi046.eocvws(active, since 68s) 2024-09-10T22:55:26.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:25 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/115700034' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:26.304 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:26.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:26.659 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:26.745 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:27.552 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:27.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:27 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2155645051' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:29.704 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:29.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:30.919 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: Active manager daemon smithi046.eocvws restarted 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: Activating manager daemon smithi046.eocvws 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: mgrmap e15: smithi046.eocvws(active, starting, since 0.00397045s) 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr metadata", "who": "smithi046.eocvws", "id": "smithi046.eocvws"} : dispatch 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:55:31.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: Manager daemon smithi046.eocvws is now available 2024-09-10T22:55:31.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:30 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3314289796' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.eocvws/trash_purge_schedule"} : dispatch 2024-09-10T22:55:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:31 smithi046 ceph-mon[28128]: mgrmap e16: smithi046.eocvws(active, since 1.00798s) 2024-09-10T22:55:32.625 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:32.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:32.986 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:33.075 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:33.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:33.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:33.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:33 smithi046 ceph-mon[28128]: [10/Sep/2024:22:55:32] ENGINE Bus STARTING 2024-09-10T22:55:33.864 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:33.864 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:33.864 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:34 smithi046 ceph-mon[28128]: [10/Sep/2024:22:55:32] ENGINE Serving on http://172.21.15.46:8765 2024-09-10T22:55:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:34 smithi046 ceph-mon[28128]: [10/Sep/2024:22:55:32] ENGINE Serving on https://172.21.15.46:7150 2024-09-10T22:55:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:34 smithi046 ceph-mon[28128]: [10/Sep/2024:22:55:32] ENGINE Bus STARTED 2024-09-10T22:55:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:34 smithi046 ceph-mon[28128]: [10/Sep/2024:22:55:32] ENGINE Error in HTTPServer.serve 2024-09-10T22:55:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:55:35.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:34 smithi046 ceph-mon[28128]: mgrmap e17: smithi046.eocvws(active, since 2s) 2024-09-10T22:55:35.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:34 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1116799701' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:35.693 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:35.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:36.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:55:37.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:37.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:37.920 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:37.921 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:37.921 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:38.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:38.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:38.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"} : dispatch 2024-09-10T22:55:38.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:38 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/387301246' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:39.942 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:39.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"} : dispatch 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-10T22:55:40.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:40 smithi046 ceph-mon[28128]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T22:55:41.192 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:41.192 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: Updating smithi073:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: Updating smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1959342718' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:41.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-10T22:55:41.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T22:55:41.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:55:42.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:42 smithi046 ceph-mon[28128]: Updating smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:55:42.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:42 smithi046 ceph-mon[28128]: Updating smithi073:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:55:42.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:42 smithi046 ceph-mon[28128]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-09-10T22:55:42.895 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:42.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:43.476 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:44.464 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:44.464 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:44.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:44 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1746276264' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:46.335 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:46.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:47.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:47.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:47.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:47.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:55:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T22:55:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:55:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: Deploying daemon crash.smithi073 on smithi073 2024-09-10T22:55:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:55:47.654 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:48.584 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:48.585 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:48.585 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:49.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:48 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3354334002' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:50.549 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:50.549 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:50.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:50.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:50.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:50.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:50.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:50 smithi046 ceph-mon[28128]: Deploying daemon node-exporter.smithi073 on smithi073 2024-09-10T22:55:51.169 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:52.025 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:52.025 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:52.026 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:52 smithi046 ceph-mon[28128]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:52 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/794438600' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:54.436 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:54.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:54.815 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:54.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:54 smithi046 ceph-mon[28128]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:55.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:55.872 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:55.872 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:55:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi073.lkiuuj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:55:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.lkiuuj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:55:56.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:55:56.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:55:56.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: Deploying daemon mgr.smithi073.lkiuuj on smithi073 2024-09-10T22:55:56.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:55 smithi046 ceph-mon[28128]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:57.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:56 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1542425731' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:55:57.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:56 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:55:57.857 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:55:57.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:55:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:57 smithi046 ceph-mon[28128]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:55:58.424 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:55:59.269 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:55:59.269 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:55:59.269 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/583054162' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:56:00.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:55:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:00 smithi046 ceph-mon[28128]: Deploying daemon mon.smithi073 on smithi073 2024-09-10T22:56:01.326 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:56:01.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:56:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:01 smithi046 ceph-mon[28128]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:56:03.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:56:03.824 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:53:07.825757Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:56:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-10T22:56:04.233 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:03 smithi073 podman[35443]: 2024-09-10 22:56:03.844063038 +0000 UTC m=+0.028968017 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:56:04.233 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 podman[35443]: 2024-09-10 22:56:04.232513547 +0000 UTC m=+0.417418524 container create 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:56:04.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:03 smithi046 ceph-mon[28128]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:03 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3979194262' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:04.494 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 podman[35443]: 2024-09-10 22:56:04.451832646 +0000 UTC m=+0.636737624 container init 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T22:56:04.494 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 podman[35443]: 2024-09-10 22:56:04.458708653 +0000 UTC m=+0.643613633 container start 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:56:04.747 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T22:56:04.747 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T22:56:04.747 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pidfile_write: ignore empty --pid-file 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: load: jerasure load: lrc 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: RocksDB version: 7.9.2 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Git sha 0 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: DB SUMMARY 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: DB Session ID: ESTCK59G1SQL6QAV8CEQ 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: CURRENT file: CURRENT 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi073/store.db dir, Total Num: 0, files: 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi073/store.db: 000004.log size: 511 ; 2024-09-10T22:56:04.748 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.error_if_exists: 0 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.create_if_missing: 0 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.paranoid_checks: 1 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.env: 0x5578464e9180 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.info_log: 0x557882f198c0 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.statistics: (nil) 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.use_fsync: 0 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_log_file_size: 0 2024-09-10T22:56:04.749 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.allow_fallocate: 1 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.use_direct_reads: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.db_log_dir: 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.wal_dir: 2024-09-10T22:56:04.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T22:56:04.752 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.write_buffer_manager: 0x557882f1db80 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.unordered_write: 0 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T22:56:04.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.row_cache: None 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.wal_filter: None 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.two_write_queues: 0 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T22:56:04.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.wal_compression: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.atomic_flush: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.log_readahead_size: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T22:56:04.755 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_background_jobs: 2 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_background_compactions: -1 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_subcompactions: 1 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T22:56:04.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_open_files: -1 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_background_flushes: -1 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Compression algorithms supported: 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kZSTD supported: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kXpressCompression supported: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kBZip2Compression supported: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kLZ4Compression supported: 1 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kZlibCompression supported: 1 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T22:56:04.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: kSnappyCompression supported: 1 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000005 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.merge_operator: 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_filter: None 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557882f19500) 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-09-10T22:56:04.758 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_type: 0 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_index_type: 0 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_shortening: 1 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: checksum: 4 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: no_block_cache: 0 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache: 0x557882f0d610 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_options: 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: capacity : 536870912 2024-09-10T22:56:04.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_shard_bits : 4 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: strict_capacity_limit : 0 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_compressed: (nil) 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: persistent_cache: (nil) 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size: 4096 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size_deviation: 10 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_restart_interval: 16 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_block_restart_interval: 1 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_block_size: 4096 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: partition_filters: 0 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: use_delta_encoding: 1 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: filter_policy: bloomfilter 2024-09-10T22:56:04.760 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: whole_key_filtering: 1 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: verify_compression: 0 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: format_version: 5 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_index_compression: 1 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_align: 0 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_auto_readahead_size: 262144 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: prepopulate_block_cache: 0 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: initial_auto_readahead_size: 8192 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression: NoCompression 2024-09-10T22:56:04.761 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.num_levels: 7 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T22:56:04.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T22:56:04.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T22:56:04.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T22:56:04.765 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.inplace_update_support: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.bloom_locality: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.max_successive_merges: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T22:56:04.766 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.ttl: 2592000 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.enable_blob_files: false 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.min_blob_size: 0 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T22:56:04.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b6d0f587-ca1b-438b-a50e-56ba4fa4a409 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726008964502462, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726008964503180, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726008964, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b6d0f587-ca1b-438b-a50e-56ba4fa4a409", "db_session_id": "ESTCK59G1SQL6QAV8CEQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726008964503490, "job": 1, "event": "recovery_finished"} 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi073/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557882f3ee00 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: DB pointer 0x55788303e000 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T22:56:04.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** DB Stats ** 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T22:56:04.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T22:56:04.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache BinnedLRUCache@0x557882f0d610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073 does not exist in monmap, will attempt to join an existing cluster 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: using public_addr v2:172.21.15.73:0/0 -> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-10T22:56:04.771 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: starting mon.smithi073 rank -1 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi073 fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(???) e0 preinit fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).mds e1 new map 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).mds e1 print_map 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: e1 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: btime 2024-09-10T22:53:11:794363+0000 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: legacy client fscid: -1 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: No filesystems configured 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T22:56:04.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: Deploying daemon crash.smithi073 on smithi073 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/3354334002' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.774 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: Deploying daemon node-exporter.smithi073 on smithi073 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/794438600' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi073.lkiuuj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.lkiuuj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: Deploying daemon mgr.smithi073.lkiuuj on smithi073 2024-09-10T22:56:04.775 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/1542425731' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/583054162' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:04.776 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: Deploying daemon mon.smithi073 on smithi073 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/3979194262' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 ceph-mon[35473]: mon.smithi073@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 bash[35443]: 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 2024-09-10T22:56:04.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:04 smithi073 systemd[1]: Started Ceph mon.smithi073 for 52773b64-6fc7-11ef-bcea-c7b262605968. 2024-09-10T22:56:06.136 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T22:56:06.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:56:06.508 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T22:56:10.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:56:10.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: mon.smithi046 calling monitor election 2024-09-10T22:56:10.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/smithi073.lkiuuj/crt"} : dispatch 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: mon.smithi073 calling monitor election 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: mon.smithi046 is new leader, mons smithi046,smithi073 in quorum (ranks 0,1) 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: monmap epoch 2 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:56:10.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: last_changed 2024-09-10T22:56:04.547688+0000 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: created 2024-09-10T22:53:07.825757+0000 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: min_mon_release 19 (squid) 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: election_strategy: 1 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: fsmap 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: mgrmap e17: smithi046.eocvws(active, since 38s) 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: overall HEALTH_OK 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: Standby manager daemon smithi073.lkiuuj started 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:56:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/smithi073.lkiuuj/key"} : dispatch 2024-09-10T22:56:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:56:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:56:10.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: mon.smithi046 calling monitor election 2024-09-10T22:56:10.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:10.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/smithi073.lkiuuj/crt"} : dispatch 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: mon.smithi073 calling monitor election 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: mon.smithi046 is new leader, mons smithi046,smithi073 in quorum (ranks 0,1) 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: monmap epoch 2 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: fsid 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: last_changed 2024-09-10T22:56:04.547688+0000 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: created 2024-09-10T22:53:07.825757+0000 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: min_mon_release 19 (squid) 2024-09-10T22:56:10.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: election_strategy: 1 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: fsmap 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: mgrmap e17: smithi046.eocvws(active, since 38s) 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: overall HEALTH_OK 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: Standby manager daemon smithi073.lkiuuj started 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/smithi073.lkiuuj/key"} : dispatch 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.? 172.21.15.73:0/818623728' entity='mgr.smithi073.lkiuuj' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:10.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:56:10.425 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","modified":"2024-09-10T22:56:04.547688Z","created":"2024-09-10T22:53:07.825757Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T22:56:10.425 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 2 2024-09-10T22:56:10.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:10 smithi073 ceph-mon[35473]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:10.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:10 smithi073 ceph-mon[35473]: mgrmap e18: smithi046.eocvws(active, since 38s), standbys: smithi073.lkiuuj 2024-09-10T22:56:10.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr metadata", "who": "smithi073.lkiuuj", "id": "smithi073.lkiuuj"} : dispatch 2024-09-10T22:56:10.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:56:10.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:10 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/1252904303' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:10.764 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:10 smithi046 ceph-mon[28128]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:10 smithi046 ceph-mon[28128]: mgrmap e18: smithi046.eocvws(active, since 38s), standbys: smithi073.lkiuuj 2024-09-10T22:56:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr metadata", "who": "smithi073.lkiuuj", "id": "smithi073.lkiuuj"} : dispatch 2024-09-10T22:56:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:56:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:10 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1252904303' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:56:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:56:11.791 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T22:56:11.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T22:56:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:12.450 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:12 smithi073 ceph-mon[35473]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:12.450 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:12.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:12 smithi046 ceph-mon[28128]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:12.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:12.906 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:56:12.906 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-09-10T22:56:12.906 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T22:56:12.906 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-10T22:56:13.704 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T22:56:13.704 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:56:13.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:56:13.763 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:56:13.764 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:56:13.864 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:56:13.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:56:13.923 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:56:13.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:56:14.021 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T22:56:14.021 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T22:56:14.025 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T22:56:14.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T22:56:14.071 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T22:56:14.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T22:56:14.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/33947477' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: Updating smithi073:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: Updating smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.117 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T22:56:14.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T22:56:14.164 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T22:56:14.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T22:56:14.210 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T22:56:14.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T22:56:14.256 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T22:56:14.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T22:56:14.307 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T22:56:14.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T22:56:14.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/33947477' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: Updating smithi073:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: Updating smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:14.359 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T22:56:14.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T22:56:14.417 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T22:56:14.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T22:56:14.468 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T22:56:14.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T22:56:14.525 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T22:56:14.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T22:56:14.580 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T22:56:14.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T22:56:14.636 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T22:56:14.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T22:56:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:14.697 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T22:56:14.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T22:56:14.757 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T22:56:14.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T22:56:14.814 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T22:56:14.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T22:56:14.878 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T22:56:14.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T22:56:14.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:14 smithi046 ceph-mon[28128]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-09-10T22:56:14.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:56:14.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:56:14.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:14.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:14 smithi046 ceph-mon[28128]: Reconfiguring daemon mon.smithi046 on smithi046 2024-09-10T22:56:14.907 DEBUG:tasks.cephadm:set 18 configs 2024-09-10T22:56:14.908 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi046') 2024-09-10T22:56:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:14 smithi073 ceph-mon[35473]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-09-10T22:56:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:56:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:56:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:14 smithi073 ceph-mon[35473]: Reconfiguring daemon mon.smithi046 on smithi046 2024-09-10T22:56:16.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:15 smithi046 ceph-mon[28128]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:15 smithi073 ceph-mon[35473]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:17.012 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2476937360' entity='client.admin' 2024-09-10T22:56:17.012 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:17.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:17.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:17.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi046.eocvws", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:56:17.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:56:17.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2476937360' entity='client.admin' 2024-09-10T22:56:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi046.eocvws", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:56:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:56:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:17.383 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi046') 2024-09-10T22:56:17.402 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:17.445 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:17.467 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:17.497 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:17.697 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:18.158 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:17 smithi046 ceph-mon[28128]: Reconfiguring mgr.smithi046.eocvws (unknown last config time)... 2024-09-10T22:56:18.158 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:17 smithi046 ceph-mon[28128]: Reconfiguring daemon mgr.smithi046.eocvws on smithi046 2024-09-10T22:56:18.158 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:17 smithi046 ceph-mon[28128]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:17 smithi073 ceph-mon[35473]: Reconfiguring mgr.smithi046.eocvws (unknown last config time)... 2024-09-10T22:56:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:17 smithi073 ceph-mon[35473]: Reconfiguring daemon mgr.smithi046.eocvws on smithi046 2024-09-10T22:56:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:17 smithi073 ceph-mon[35473]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:18.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 -- 172.21.15.46:0/2968652080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 msgr2=0x7fdeac103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:18.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 --2- 172.21.15.46:0/2968652080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac103be0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde98009880 tx=0x7fde9802a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:18.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 -- 172.21.15.46:0/2968652080 shutdown_connections 2024-09-10T22:56:18.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 --2- 172.21.15.46:0/2968652080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac103be0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:18.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 --2- 172.21.15.46:0/2968652080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeac102600 0x7fdeac102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:18.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 -- 172.21.15.46:0/2968652080 >> 172.21.15.46:0/2968652080 conn(0x7fdeac0fdef0 msgr2=0x7fdeac100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 -- 172.21.15.46:0/2968652080 shutdown_connections 2024-09-10T22:56:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.903+0000 7fdeb2200640 1 -- 172.21.15.46:0/2968652080 wait complete. 2024-09-10T22:56:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.904+0000 7fdeb2200640 1 Processor -- start 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.904+0000 7fdeb2200640 1 -- start start 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.904+0000 7fdeb2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeac102600 0x7fdeac19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.905+0000 7fdeb2200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.905+0000 7fdeb2200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac10af80 con 0x7fdeac103760 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.905+0000 7fdeb2200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac10ae00 con 0x7fdeac102600 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.905+0000 7fdeabe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.905+0000 7fdeabe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41598/0 (socket says 172.21.15.46:41598) 2024-09-10T22:56:18.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.905+0000 7fdeabe00640 1 -- 172.21.15.46:0/1798093079 learned_addr learned my addr 172.21.15.46:0/1798093079 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.906+0000 7fdeabe00640 1 -- 172.21.15.46:0/1798093079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeac102600 msgr2=0x7fdeac19a060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.906+0000 7fdeabe00640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeac102600 0x7fdeac19a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.906+0000 7fdeabe00640 1 -- 172.21.15.46:0/1798093079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac19b280 con 0x7fdeac103760 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.907+0000 7fdeabe00640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac19a6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde98005940 tx=0x7fde98004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.907+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde9803f070 con 0x7fdeac103760 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.908+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7fde98003a20 con 0x7fdeac103760 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.908+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde98035030 con 0x7fdeac103760 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.908+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac19b510 con 0x7fdeac103760 2024-09-10T22:56:18.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.908+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac19bac0 con 0x7fdeac103760 2024-09-10T22:56:18.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.909+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeac10b6d0 con 0x7fdeac103760 2024-09-10T22:56:18.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.911+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fde9803b7e0 con 0x7fdeac103760 2024-09-10T22:56:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.913+0000 7fdea9600640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fde9407a320 0x7fde9407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.913+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fde980bd480 con 0x7fdeac103760 2024-09-10T22:56:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.913+0000 7fdeb0e00640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fde9407a320 0x7fde9407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.914+0000 7fdeb0e00640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fde9407a320 0x7fde9407c7e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdea000a890 tx=0x7fdea0005b80 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:18.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.915+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fde98086030 con 0x7fdeac103760 2024-09-10T22:56:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.115+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fdeac102a00 con 0x7fdeac103760 2024-09-10T22:56:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.119+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v13)=0 v13) ==== 114+0+0 (secure 0 0 0) 0x7fde9808a410 con 0x7fdeac103760 2024-09-10T22:56:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.120+0000 7fdea9600640 1 -- 172.21.15.46:0/1798093079 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fde98003bd0 con 0x7fdeac103760 2024-09-10T22:56:19.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fde9407a320 msgr2=0x7fde9407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fde9407a320 0x7fde9407c7e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdea000a890 tx=0x7fdea0005b80 comp rx=0 tx=0).stop 2024-09-10T22:56:19.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 msgr2=0x7fdeac19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac19a6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde98005940 tx=0x7fde98004270 comp rx=0 tx=0).stop 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 shutdown_connections 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fde9407a320 0x7fde9407c7e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeac103760 0x7fdeac19a6b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 --2- 172.21.15.46:0/1798093079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeac102600 0x7fdeac19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 >> 172.21.15.46:0/1798093079 conn(0x7fdeac0fdef0 msgr2=0x7fdeac0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 shutdown_connections 2024-09-10T22:56:19.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.122+0000 7fdeb2200640 1 -- 172.21.15.46:0/1798093079 wait complete. 2024-09-10T22:56:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 -- 172.21.15.46:0/2761732323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 msgr2=0x7f487c105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 --2- 172.21.15.46:0/2761732323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c105fa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4868009880 tx=0x7f486802a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 -- 172.21.15.46:0/2761732323 shutdown_connections 2024-09-10T22:56:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 --2- 172.21.15.46:0/2761732323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c105fa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 --2- 172.21.15.46:0/2761732323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f487c1049c0 0x7f487c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 -- 172.21.15.46:0/2761732323 >> 172.21.15.46:0/2761732323 conn(0x7f487c1002d0 msgr2=0x7f487c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.103+0000 7f4884000640 1 -- 172.21.15.46:0/2761732323 shutdown_connections 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.104+0000 7f4884000640 1 -- 172.21.15.46:0/2761732323 wait complete. 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.104+0000 7f4884000640 1 Processor -- start 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4884000640 1 -- start start 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4884000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f487c1049c0 0x7f487c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4884000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4884000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f487c10d3c0 con 0x7f487c105b20 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4884000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f487c10d240 con 0x7f487c1049c0 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4880c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4880c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41628/0 (socket says 172.21.15.46:41628) 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4880c00640 1 -- 172.21.15.46:0/436413016 learned_addr learned my addr 172.21.15.46:0/436413016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.105+0000 7f4881600640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f487c1049c0 0x7f487c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f4880c00640 1 -- 172.21.15.46:0/436413016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f487c1049c0 msgr2=0x7f487c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f4880c00640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f487c1049c0 0x7f487c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f4880c00640 1 -- 172.21.15.46:0/436413016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c19b530 con 0x7f487c105b20 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f4880c00640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c19a960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4868009230 tx=0x7f4868004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f486803f070 con 0x7f487c105b20 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f4868003a20 con 0x7f487c105b20 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c19b7c0 con 0x7f487c105b20 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4868035030 con 0x7f487c105b20 2024-09-10T22:56:19.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.106+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c19bd70 con 0x7f487c105b20 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.107+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c10db10 con 0x7f487c105b20 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.108+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f4868003bd0 con 0x7f487c105b20 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.109+0000 7f487a000640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f486407a290 0x7f486407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.109+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f48680bcf70 con 0x7f487c105b20 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.110+0000 7f4881600640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f486407a290 0x7f486407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.110+0000 7f4881600640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f486407a290 0x7f486407c750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4870009990 tx=0x7f4870009110 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.114+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4868085a20 con 0x7f487c105b20 2024-09-10T22:56:19.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.120+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f4868084e30 con 0x7f487c105b20 2024-09-10T22:56:19.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.318+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f487c19c120 con 0x7f487c105b20 2024-09-10T22:56:19.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.322+0000 7f487a000640 1 -- 172.21.15.46:0/436413016 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f486808e820 con 0x7f487c105b20 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.324+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f486407a290 msgr2=0x7f486407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.324+0000 7f4884000640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f486407a290 0x7f486407c750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4870009990 tx=0x7f4870009110 comp rx=0 tx=0).stop 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 msgr2=0x7f487c19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c19a960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4868009230 tx=0x7f4868004270 comp rx=0 tx=0).stop 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 shutdown_connections 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f486407a290 0x7f486407c750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487c105b20 0x7f487c19a960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 --2- 172.21.15.46:0/436413016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f487c1049c0 0x7f487c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 >> 172.21.15.46:0/436413016 conn(0x7f487c1002d0 msgr2=0x7f487c109170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 shutdown_connections 2024-09-10T22:56:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:19.325+0000 7f4884000640 1 -- 172.21.15.46:0/436413016 wait complete. 2024-09-10T22:56:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 -- 172.21.15.46:0/2436778853 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f30e807a320 msgr2=0x7f30e807c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 --2- 172.21.15.46:0/2436778853 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f30e807a320 0x7f30e807c7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30f4005fd0 tx=0x7f30f4005850 comp rx=0 tx=0).stop 2024-09-10T22:56:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 -- 172.21.15.46:0/2436778853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3104103760 msgr2=0x7f310419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 --2- 172.21.15.46:0/2436778853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3104103760 0x7f310419a600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f30f0006010 tx=0x7f30f0004e60 comp rx=0 tx=0).stop 2024-09-10T22:56:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 -- 172.21.15.46:0/2436778853 shutdown_connections 2024-09-10T22:56:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 --2- 172.21.15.46:0/2436778853 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f30e807a320 0x7f30e807c7e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 --2- 172.21.15.46:0/2436778853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3104103760 0x7f310419a600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 --2- 172.21.15.46:0/2436778853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104102600 0x7f3104199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.225+0000 7f3109800640 1 -- 172.21.15.46:0/2436778853 >> 172.21.15.46:0/2436778853 conn(0x7f31040fdef0 msgr2=0x7f3104104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.226+0000 7f3109800640 1 -- 172.21.15.46:0/2436778853 shutdown_connections 2024-09-10T22:56:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:18.226+0000 7f3109800640 1 -- 172.21.15.46:0/2436778853 wait complete. 2024-09-10T22:56:19.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:19 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2436778853' entity='client.admin' 2024-09-10T22:56:19.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:19 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1798093079' entity='client.admin' 2024-09-10T22:56:19.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:19 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2436778853' entity='client.admin' 2024-09-10T22:56:19.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:19 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1798093079' entity='client.admin' 2024-09-10T22:56:20.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:20 smithi046 ceph-mon[28128]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:20.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:20 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/436413016' entity='client.admin' 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 -- 172.21.15.46:0/3380133188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 msgr2=0x7f2cc8075580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 --2- 172.21.15.46:0/3380133188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc8075580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009880 tx=0x7f2cbc02a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 -- 172.21.15.46:0/3380133188 shutdown_connections 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 --2- 172.21.15.46:0/3380133188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8075ac0 0x7f2cc8075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 --2- 172.21.15.46:0/3380133188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc8075580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 -- 172.21.15.46:0/3380133188 >> 172.21.15.46:0/3380133188 conn(0x7f2cc80fe0a0 msgr2=0x7f2cc81004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 -- 172.21.15.46:0/3380133188 shutdown_connections 2024-09-10T22:56:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.450+0000 7f2cd0800640 1 -- 172.21.15.46:0/3380133188 wait complete. 2024-09-10T22:56:20.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.451+0000 7f2cd0800640 1 Processor -- start 2024-09-10T22:56:20.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2cd0800640 1 -- start start 2024-09-10T22:56:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2cd0800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8075ac0 0x7f2cc819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2cd0800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2cd0800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810d440 con 0x7f2cc8076f20 2024-09-10T22:56:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2cd0800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810d2c0 con 0x7f2cc8075ac0 2024-09-10T22:56:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2ccd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2ccd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41646/0 (socket says 172.21.15.46:41646) 2024-09-10T22:56:20.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2ccd400640 1 -- 172.21.15.46:0/578116080 learned_addr learned my addr 172.21.15.46:0/578116080 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:20.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.452+0000 7f2ccde00640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8075ac0 0x7f2cc819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:20.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2ccd400640 1 -- 172.21.15.46:0/578116080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8075ac0 msgr2=0x7f2cc819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2ccd400640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8075ac0 0x7f2cc819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2ccd400640 1 -- 172.21.15.46:0/578116080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc819b560 con 0x7f2cc8076f20 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2ccd400640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc819a990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800e970 tx=0x7f2cb800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cb800cac0 con 0x7f2cc8076f20 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f2cb8005470 con 0x7f2cc8076f20 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cb8004b50 con 0x7f2cc8076f20 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.453+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc819b850 con 0x7f2cc8076f20 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.454+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc819bde0 con 0x7f2cc8076f20 2024-09-10T22:56:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.455+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc810db90 con 0x7f2cc8076f20 2024-09-10T22:56:20.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.456+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f2cb8004d70 con 0x7f2cc8076f20 2024-09-10T22:56:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.457+0000 7f2cc2a00640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f2cb007a2d0 0x7f2cb007c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.457+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2cb809c2d0 con 0x7f2cc8076f20 2024-09-10T22:56:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.457+0000 7f2ccde00640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f2cb007a2d0 0x7f2cb007c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.458+0000 7f2ccde00640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f2cb007a2d0 0x7f2cb007c790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009230 tx=0x7f2cbc005d50 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:20.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.461+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2cb8064ea0 con 0x7f2cc8076f20 2024-09-10T22:56:20.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:20 smithi073 ceph-mon[35473]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:20.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:20 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/436413016' entity='client.admin' 2024-09-10T22:56:20.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.663+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2cc819c2a0 con 0x7f2cc8076f20 2024-09-10T22:56:20.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.666+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f2cb8069280 con 0x7f2cc8076f20 2024-09-10T22:56:20.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.667+0000 7f2cc2a00640 1 -- 172.21.15.46:0/578116080 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2cb800cc60 con 0x7f2cc8076f20 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f2cb007a2d0 msgr2=0x7f2cb007c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f2cb007a2d0 0x7f2cb007c790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009230 tx=0x7f2cbc005d50 comp rx=0 tx=0).stop 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 msgr2=0x7f2cc819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc819a990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800e970 tx=0x7f2cb800ed70 comp rx=0 tx=0).stop 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 shutdown_connections 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f2cb007a2d0 0x7f2cb007c790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8076f20 0x7f2cc819a990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 --2- 172.21.15.46:0/578116080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8075ac0 0x7f2cc819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:20.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 >> 172.21.15.46:0/578116080 conn(0x7f2cc80fe0a0 msgr2=0x7f2cc81099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:20.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 shutdown_connections 2024-09-10T22:56:20.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:20.669+0000 7f2cd0800640 1 -- 172.21.15.46:0/578116080 wait complete. 2024-09-10T22:56:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 -- 172.21.15.46:0/3817618742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 msgr2=0x7f4adc1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 --2- 172.21.15.46:0/3817618742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc1029f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009880 tx=0x7f4ad002a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 -- 172.21.15.46:0/3817618742 shutdown_connections 2024-09-10T22:56:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 --2- 172.21.15.46:0/3817618742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4adc103750 0x7f4adc103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 --2- 172.21.15.46:0/3817618742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc1029f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 -- 172.21.15.46:0/3817618742 >> 172.21.15.46:0/3817618742 conn(0x7f4adc0fdec0 msgr2=0x7f4adc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 -- 172.21.15.46:0/3817618742 shutdown_connections 2024-09-10T22:56:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.452+0000 7f4ae2000640 1 -- 172.21.15.46:0/3817618742 wait complete. 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.453+0000 7f4ae2000640 1 Processor -- start 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.453+0000 7f4ae2000640 1 -- start start 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4adc103750 0x7f4adc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae2000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc10b180 con 0x7f4adc1025f0 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae2000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc10b000 con 0x7f4adc103750 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41668/0 (socket says 172.21.15.46:41668) 2024-09-10T22:56:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae0c00640 1 -- 172.21.15.46:0/1072546890 learned_addr learned my addr 172.21.15.46:0/1072546890 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4adbe00640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4adc103750 0x7f4adc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae0c00640 1 -- 172.21.15.46:0/1072546890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4adc103750 msgr2=0x7f4adc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae0c00640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4adc103750 0x7f4adc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.454+0000 7f4ae0c00640 1 -- 172.21.15.46:0/1072546890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc199210 con 0x7f4adc1025f0 2024-09-10T22:56:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.455+0000 7f4ae0c00640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc197ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0004d50 tx=0x7f4ad0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.455+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ad003f070 con 0x7f4adc1025f0 2024-09-10T22:56:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.455+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc1994a0 con 0x7f4adc1025f0 2024-09-10T22:56:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.455+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4ad0003a60 con 0x7f4adc1025f0 2024-09-10T22:56:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.455+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ad0035030 con 0x7f4adc1025f0 2024-09-10T22:56:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.455+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc199a50 con 0x7f4adc1025f0 2024-09-10T22:56:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.456+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc10b8d0 con 0x7f4adc1025f0 2024-09-10T22:56:21.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.457+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f4ad00035f0 con 0x7f4adc1025f0 2024-09-10T22:56:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.458+0000 7f4ad9600640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4ac407a2d0 0x7f4ac407c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.458+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4ad00bcce0 con 0x7f4adc1025f0 2024-09-10T22:56:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.459+0000 7f4adbe00640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4ac407a2d0 0x7f4ac407c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:21.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.459+0000 7f4adbe00640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4ac407a2d0 0x7f4ac407c790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800abe0 tx=0x7f4ac800a2d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:21.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.463+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ad0085810 con 0x7f4adc1025f0 2024-09-10T22:56:21.492 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.495 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.504 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.509 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.509 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.707+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f4adc1029f0 con 0x7f4adc1025f0 2024-09-10T22:56:21.716 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.720 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.721+0000 7f4ad9600640 1 -- 172.21.15.46:0/1072546890 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f4ad008c110 con 0x7f4adc1025f0 2024-09-10T22:56:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.728+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4ac407a2d0 msgr2=0x7f4ac407c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.728+0000 7f4ae2000640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4ac407a2d0 0x7f4ac407c790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800abe0 tx=0x7f4ac800a2d0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.728+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 msgr2=0x7f4adc197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.728+0000 7f4ae2000640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc197ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0004d50 tx=0x7f4ad0004270 comp rx=0 tx=0).stop 2024-09-10T22:56:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 shutdown_connections 2024-09-10T22:56:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4ac407a2d0 0x7f4ac407c790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4adc103750 0x7f4adc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 --2- 172.21.15.46:0/1072546890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc1025f0 0x7f4adc197ff0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 >> 172.21.15.46:0/1072546890 conn(0x7f4adc0fdec0 msgr2=0x7f4adc106cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 shutdown_connections 2024-09-10T22:56:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:21.729+0000 7f4ae2000640 1 -- 172.21.15.46:0/1072546890 wait complete. 2024-09-10T22:56:21.746 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.747 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:21.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:21 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/578116080' entity='client.admin' 2024-09-10T22:56:22.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:21 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/578116080' entity='client.admin' 2024-09-10T22:56:22.692 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi046') 2024-09-10T22:56:22.963 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:22 smithi046 ceph-mon[28128]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:22.963 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:22 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1072546890' entity='client.admin' 2024-09-10T22:56:23.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:22 smithi073 ceph-mon[35473]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:23.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:22 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1072546890' entity='client.admin' 2024-09-10T22:56:24.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.986+0000 7f8a51200640 1 -- 172.21.15.46:0/3277773582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c105970 msgr2=0x7f8a4c105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.986+0000 7f8a51200640 1 --2- 172.21.15.46:0/3277773582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c105970 0x7f8a4c105df0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009880 tx=0x7f8a3402a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.987+0000 7f8a51200640 1 -- 172.21.15.46:0/3277773582 shutdown_connections 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.987+0000 7f8a51200640 1 --2- 172.21.15.46:0/3277773582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c105970 0x7f8a4c105df0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.987+0000 7f8a51200640 1 --2- 172.21.15.46:0/3277773582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c104810 0x7f8a4c104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.987+0000 7f8a51200640 1 -- 172.21.15.46:0/3277773582 >> 172.21.15.46:0/3277773582 conn(0x7f8a4c1000e0 msgr2=0x7f8a4c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.987+0000 7f8a51200640 1 -- 172.21.15.46:0/3277773582 shutdown_connections 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.987+0000 7f8a51200640 1 -- 172.21.15.46:0/3277773582 wait complete. 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a51200640 1 Processor -- start 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a51200640 1 -- start start 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a51200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 0x7f8a4c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a51200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c105970 0x7f8a4c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a51200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c10d3c0 con 0x7f8a4c104810 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a51200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c10d240 con 0x7f8a4c105970 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a4b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 0x7f8a4c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a4b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 0x7f8a4c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49072/0 (socket says 172.21.15.46:49072) 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.988+0000 7f8a4b400640 1 -- 172.21.15.46:0/2524148706 learned_addr learned my addr 172.21.15.46:0/2524148706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a43e00640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c105970 0x7f8a4c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a4b400640 1 -- 172.21.15.46:0/2524148706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c105970 msgr2=0x7f8a4c19a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a4b400640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c105970 0x7f8a4c19a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a4b400640 1 -- 172.21.15.46:0/2524148706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c19b450 con 0x7f8a4c104810 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a43e00640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c105970 0x7f8a4c19a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a4b400640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 0x7f8a4c19a230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00d6f0 tx=0x7f8a3c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c017070 con 0x7f8a4c104810 2024-09-10T22:56:24.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8a3c00de00 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c0049d0 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.989+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c19b740 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.990+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c19bd50 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.991+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c10db10 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.992+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f8a3c004c40 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.993+0000 7f8a48c00640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3007a280 0x7f8a3007c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.993+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8a3c09ba50 con 0x7f8a4c104810 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.993+0000 7f8a43e00640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3007a280 0x7f8a3007c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.994+0000 7f8a43e00640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3007a280 0x7f8a3007c740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a34006010 tx=0x7f8a34000bc0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:24.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:23.998+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8a3c064500 con 0x7f8a4c104810 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 -- 172.21.15.46:0/2482962829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 msgr2=0x7fce30105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 --2- 172.21.15.46:0/2482962829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce30105fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fce18009880 tx=0x7fce1802a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 -- 172.21.15.46:0/2482962829 shutdown_connections 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 --2- 172.21.15.46:0/2482962829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce30105fa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 --2- 172.21.15.46:0/2482962829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce301049c0 0x7fce30104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 -- 172.21.15.46:0/2482962829 >> 172.21.15.46:0/2482962829 conn(0x7fce301002d0 msgr2=0x7fce301026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 -- 172.21.15.46:0/2482962829 shutdown_connections 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.095+0000 7fce36800640 1 -- 172.21.15.46:0/2482962829 wait complete. 2024-09-10T22:56:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce36800640 1 Processor -- start 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce36800640 1 -- start start 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce36800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce301049c0 0x7fce3019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce36800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce3019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce36800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce3010d550 con 0x7fce30105b20 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce36800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fce3010d3d0 con 0x7fce301049c0 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.096+0000 7fce27e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce3019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce27e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce3019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49090/0 (socket says 172.21.15.46:49090) 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce27e00640 1 -- 172.21.15.46:0/870015671 learned_addr learned my addr 172.21.15.46:0/870015671 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce2f400640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce301049c0 0x7fce3019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce27e00640 1 -- 172.21.15.46:0/870015671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce301049c0 msgr2=0x7fce3019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce27e00640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce301049c0 0x7fce3019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce27e00640 1 -- 172.21.15.46:0/870015671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3019b5c0 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.097+0000 7fce27e00640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce3019a9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce18005940 tx=0x7fce18005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.098+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce1803f070 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.098+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3019b850 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.098+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fce180043d0 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.098+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce18035030 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.098+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3019bd80 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.099+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3010dca0 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.101+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fce1803b890 con 0x7fce30105b20 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.102+0000 7fce2cc00640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fce1407a280 0x7fce1407c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.102+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fce180bd090 con 0x7fce30105b20 2024-09-10T22:56:24.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.102+0000 7fce2f400640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fce1407a280 0x7fce1407c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.102+0000 7fce2f400640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fce1407a280 0x7fce1407c740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce20005d00 tx=0x7fce2000b410 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:24.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.108+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fce18089fa0 con 0x7fce30105b20 2024-09-10T22:56:24.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.205+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8a4c19c1b0 con 0x7f8a4c104810 2024-09-10T22:56:24.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.209+0000 7f8a48c00640 1 -- 172.21.15.46:0/2524148706 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f8a3c0688e0 con 0x7f8a4c104810 2024-09-10T22:56:24.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3007a280 msgr2=0x7f8a3007c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3007a280 0x7f8a3007c740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a34006010 tx=0x7f8a34000bc0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 msgr2=0x7f8a4c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 0x7f8a4c19a230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00d6f0 tx=0x7f8a3c00dbb0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 shutdown_connections 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3007a280 0x7f8a3007c740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c105970 0x7f8a4c19a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 --2- 172.21.15.46:0/2524148706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a4c104810 0x7f8a4c19a230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.212+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 >> 172.21.15.46:0/2524148706 conn(0x7f8a4c1000e0 msgr2=0x7f8a4c108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.213+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 shutdown_connections 2024-09-10T22:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.213+0000 7f8a51200640 1 -- 172.21.15.46:0/2524148706 wait complete. 2024-09-10T22:56:24.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.311+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fce301942d0 con 0x7fce30105b20 2024-09-10T22:56:24.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.315+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7fce1808e9c0 con 0x7fce30105b20 2024-09-10T22:56:24.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.316+0000 7fce2cc00640 1 -- 172.21.15.46:0/870015671 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce18005490 con 0x7fce30105b20 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fce1407a280 msgr2=0x7fce1407c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fce1407a280 0x7fce1407c740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce20005d00 tx=0x7fce2000b410 comp rx=0 tx=0).stop 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 msgr2=0x7fce3019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce3019a9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce18005940 tx=0x7fce18005420 comp rx=0 tx=0).stop 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 shutdown_connections 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fce1407a280 0x7fce1407c740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce30105b20 0x7fce3019a9f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 --2- 172.21.15.46:0/870015671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce301049c0 0x7fce3019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 >> 172.21.15.46:0/870015671 conn(0x7fce301002d0 msgr2=0x7fce30108fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:24.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 shutdown_connections 2024-09-10T22:56:24.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.318+0000 7fce36800640 1 -- 172.21.15.46:0/870015671 wait complete. 2024-09-10T22:56:24.651 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.838+0000 7f80ee200640 1 -- 172.21.15.46:0/655333617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 msgr2=0x7f80e8103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.838+0000 7f80ee200640 1 --2- 172.21.15.46:0/655333617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8103be0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009880 tx=0x7f80d002a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.839+0000 7f80ee200640 1 -- 172.21.15.46:0/655333617 shutdown_connections 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.839+0000 7f80ee200640 1 --2- 172.21.15.46:0/655333617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8103be0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.839+0000 7f80ee200640 1 --2- 172.21.15.46:0/655333617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80e8102600 0x7f80e8102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.839+0000 7f80ee200640 1 -- 172.21.15.46:0/655333617 >> 172.21.15.46:0/655333617 conn(0x7f80e80fdef0 msgr2=0x7f80e8100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.839+0000 7f80ee200640 1 -- 172.21.15.46:0/655333617 shutdown_connections 2024-09-10T22:56:24.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.839+0000 7f80ee200640 1 -- 172.21.15.46:0/655333617 wait complete. 2024-09-10T22:56:24.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80ee200640 1 Processor -- start 2024-09-10T22:56:24.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80ee200640 1 -- start start 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80ee200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80e8102600 0x7f80e81981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80ee200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80ee200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f80e810b350 con 0x7f80e8103760 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80ee200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f80e810b1d0 con 0x7f80e8102600 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80dfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80dfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49108/0 (socket says 172.21.15.46:49108) 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.840+0000 7f80dfe00640 1 -- 172.21.15.46:0/2138147080 learned_addr learned my addr 172.21.15.46:0/2138147080 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.841+0000 7f80ece00640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80e8102600 0x7f80e81981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.841+0000 7f80dfe00640 1 -- 172.21.15.46:0/2138147080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80e8102600 msgr2=0x7f80e81981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.841+0000 7f80dfe00640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80e8102600 0x7f80e81981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:24.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.841+0000 7f80dfe00640 1 -- 172.21.15.46:0/2138147080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e81993f0 con 0x7f80e8103760 2024-09-10T22:56:24.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.841+0000 7f80dfe00640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8198820 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009230 tx=0x7f80d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:24.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.841+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80d003f070 con 0x7f80e8103760 2024-09-10T22:56:24.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.842+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80d00052d0 con 0x7f80e8103760 2024-09-10T22:56:24.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.842+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e8199680 con 0x7f80e8103760 2024-09-10T22:56:24.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.842+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80d0035030 con 0x7f80e8103760 2024-09-10T22:56:24.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.842+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e8199c30 con 0x7f80e8103760 2024-09-10T22:56:24.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.843+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e810baa0 con 0x7f80e8103760 2024-09-10T22:56:24.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.844+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f80d0003c30 con 0x7f80e8103760 2024-09-10T22:56:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.847+0000 7f80e6000640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f80cc07a2d0 0x7f80cc07c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.847+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f80d00bcd30 con 0x7f80e8103760 2024-09-10T22:56:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.847+0000 7f80ece00640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f80cc07a2d0 0x7f80cc07c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.848+0000 7f80ece00640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f80cc07a2d0 0x7f80cc07c790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009990 tx=0x7f80d8009110 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:24.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:24.851+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80d0085860 con 0x7f80e8103760 2024-09-10T22:56:24.946 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:24 smithi046 ceph-mon[28128]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:24.946 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:24 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2524148706' entity='client.admin' 2024-09-10T22:56:24.946 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:24 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/870015671' entity='client.admin' 2024-09-10T22:56:25.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.051+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f80e8199fa0 con 0x7f80e8103760 2024-09-10T22:56:25.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.055+0000 7f80e6000640 1 -- 172.21.15.46:0/2138147080 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f80d0089c40 con 0x7f80e8103760 2024-09-10T22:56:25.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.057+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f80cc07a2d0 msgr2=0x7f80cc07c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.057+0000 7f80ee200640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f80cc07a2d0 0x7f80cc07c790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009990 tx=0x7f80d8009110 comp rx=0 tx=0).stop 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.057+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 msgr2=0x7f80e8198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.057+0000 7f80ee200640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8198820 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009230 tx=0x7f80d0004270 comp rx=0 tx=0).stop 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 shutdown_connections 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f80cc07a2d0 0x7f80cc07c790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80e8103760 0x7f80e8198820 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 --2- 172.21.15.46:0/2138147080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80e8102600 0x7f80e81981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 >> 172.21.15.46:0/2138147080 conn(0x7f80e80fdef0 msgr2=0x7f80e8106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 shutdown_connections 2024-09-10T22:56:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.058+0000 7f80ee200640 1 -- 172.21.15.46:0/2138147080 wait complete. 2024-09-10T22:56:25.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:24 smithi073 ceph-mon[35473]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:25.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:24 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2524148706' entity='client.admin' 2024-09-10T22:56:25.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:24 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/870015671' entity='client.admin' 2024-09-10T22:56:26.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.771+0000 7fc8c5200640 1 -- 172.21.15.46:0/3571016888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0102600 msgr2=0x7fc8c0102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.771+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3571016888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0102600 0x7fc8c0102a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009880 tx=0x7fc8b002a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.772+0000 7fc8c5200640 1 -- 172.21.15.46:0/3571016888 shutdown_connections 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.772+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3571016888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c0103760 0x7fc8c0103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.772+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3571016888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0102600 0x7fc8c0102a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.772+0000 7fc8c5200640 1 -- 172.21.15.46:0/3571016888 >> 172.21.15.46:0/3571016888 conn(0x7fc8c00fdef0 msgr2=0x7fc8c0100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.772+0000 7fc8c5200640 1 -- 172.21.15.46:0/3571016888 shutdown_connections 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.772+0000 7fc8c5200640 1 -- 172.21.15.46:0/3571016888 wait complete. 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8c5200640 1 Processor -- start 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8c5200640 1 -- start start 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8c5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c0102600 0x7fc8c019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:26.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8c5200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 0x7fc8c019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8c5200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c010b350 con 0x7fc8c0103760 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8c5200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c010b1d0 con 0x7fc8c0102600 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8bea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 0x7fc8c019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8bea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 0x7fc8c019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49136/0 (socket says 172.21.15.46:49136) 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.773+0000 7fc8bea00640 1 -- 172.21.15.46:0/3097940687 learned_addr learned my addr 172.21.15.46:0/3097940687 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8bf400640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c0102600 0x7fc8c019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8bea00640 1 -- 172.21.15.46:0/3097940687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c0102600 msgr2=0x7fc8c019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8bea00640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c0102600 0x7fc8c019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8bea00640 1 -- 172.21.15.46:0/3097940687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c019b5f0 con 0x7fc8c0103760 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8bea00640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 0x7fc8c019aa20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b420 tx=0x7fc8ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8ac011630 con 0x7fc8c0103760 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.774+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8ac016070 con 0x7fc8c0103760 2024-09-10T22:56:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.775+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8ac010b80 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.775+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c019b8e0 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.775+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c019bef0 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.776+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c0102a80 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.778+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fc8ac0117d0 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.779+0000 7fc8b7e00640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8a407a290 0x7fc8a407c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.779+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc8ac09b580 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.780+0000 7fc8bf400640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8a407a290 0x7fc8a407c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.780+0000 7fc8bf400640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8a407a290 0x7fc8a407c750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.784+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8ac064030 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.006+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc8c002e5c0 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.010+0000 7fc8b7e00640 1 -- 172.21.15.46:0/3097940687 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v21)=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7fc8ac068410 con 0x7fc8c0103760 2024-09-10T22:56:26.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8a407a290 msgr2=0x7fc8a407c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8a407a290 0x7fc8a407c750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0004d70 comp rx=0 tx=0).stop 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 msgr2=0x7fc8c019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 0x7fc8c019aa20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b420 tx=0x7fc8ac00b8e0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 shutdown_connections 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8a407a290 0x7fc8a407c750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8c0103760 0x7fc8c019aa20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 --2- 172.21.15.46:0/3097940687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c0102600 0x7fc8c019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.012+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 >> 172.21.15.46:0/3097940687 conn(0x7fc8c00fdef0 msgr2=0x7fc8c0104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.013+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 shutdown_connections 2024-09-10T22:56:26.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.013+0000 7fc8c5200640 1 -- 172.21.15.46:0/3097940687 wait complete. 2024-09-10T22:56:26.280 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:26 smithi046 ceph-mon[28128]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:26.280 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:26 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2138147080' entity='client.admin' 2024-09-10T22:56:26.280 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:26 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3665070197' entity='client.admin' 2024-09-10T22:56:26.280 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:26 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3097940687' entity='client.admin' 2024-09-10T22:56:26.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:26 smithi073 ceph-mon[35473]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:26.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:26 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2138147080' entity='client.admin' 2024-09-10T22:56:26.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:26 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3665070197' entity='client.admin' 2024-09-10T22:56:26.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:26 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3097940687' entity='client.admin' 2024-09-10T22:56:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 -- 172.21.15.46:0/1614341497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64102600 msgr2=0x7fad64102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 --2- 172.21.15.46:0/1614341497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64102600 0x7fad64102a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad54009880 tx=0x7fad5402a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 -- 172.21.15.46:0/1614341497 shutdown_connections 2024-09-10T22:56:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 --2- 172.21.15.46:0/1614341497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad64103760 0x7fad64103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 --2- 172.21.15.46:0/1614341497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64102600 0x7fad64102a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 -- 172.21.15.46:0/1614341497 >> 172.21.15.46:0/1614341497 conn(0x7fad640fdef0 msgr2=0x7fad64100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 -- 172.21.15.46:0/1614341497 shutdown_connections 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.654+0000 7fad69000640 1 -- 172.21.15.46:0/1614341497 wait complete. 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.655+0000 7fad69000640 1 Processor -- start 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.655+0000 7fad69000640 1 -- start start 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad69000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad64102600 0x7fad6419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad69000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 0x7fad6419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad69000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fad6410b2d0 con 0x7fad64103760 2024-09-10T22:56:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad69000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad6410b150 con 0x7fad64102600 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad62a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 0x7fad6419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad62a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 0x7fad6419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49116/0 (socket says 172.21.15.46:49116) 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad62a00640 1 -- 172.21.15.46:0/3665070197 learned_addr learned my addr 172.21.15.46:0/3665070197 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.656+0000 7fad63400640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad64102600 0x7fad6419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad62a00640 1 -- 172.21.15.46:0/3665070197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad64102600 msgr2=0x7fad6419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad62a00640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad64102600 0x7fad6419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad62a00640 1 -- 172.21.15.46:0/3665070197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6419b500 con 0x7fad64103760 2024-09-10T22:56:27.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad62a00640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 0x7fad6419a930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad5000c8a0 tx=0x7fad5000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad500079b0 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad5000f450 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad50018630 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6419b7f0 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.657+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6419be00 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.659+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6410ba20 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.660+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fad50007b50 con 0x7fad64103760 2024-09-10T22:56:27.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.661+0000 7fad5be00640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fad4807a290 0x7fad4807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.661+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fad5009bff0 con 0x7fad64103760 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.661+0000 7fad63400640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fad4807a290 0x7fad4807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.662+0000 7fad63400640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fad4807a290 0x7fad4807c750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad54000c00 tx=0x7fad54004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.665+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fad50014030 con 0x7fad64103760 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.894+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fad641a0690 con 0x7fad64103760 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.897+0000 7fad5be00640 1 -- 172.21.15.46:0/3665070197 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7fad50064aa0 con 0x7fad64103760 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fad4807a290 msgr2=0x7fad4807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fad4807a290 0x7fad4807c750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad54000c00 tx=0x7fad54004d70 comp rx=0 tx=0).stop 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 msgr2=0x7fad6419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 0x7fad6419a930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad5000c8a0 tx=0x7fad5000cd60 comp rx=0 tx=0).stop 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 shutdown_connections 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fad4807a290 0x7fad4807c750 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad64103760 0x7fad6419a930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 --2- 172.21.15.46:0/3665070197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad64102600 0x7fad6419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 >> 172.21.15.46:0/3665070197 conn(0x7fad640fdef0 msgr2=0x7fad64075480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 shutdown_connections 2024-09-10T22:56:27.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:25.900+0000 7fad69000640 1 -- 172.21.15.46:0/3665070197 wait complete. 2024-09-10T22:56:27.709 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:27 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1742516689' entity='client.admin' 2024-09-10T22:56:27.747 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-10T22:56:27.747 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi046') 2024-09-10T22:56:27.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.292+0000 7f31de800640 1 -- 172.21.15.46:0/3914529732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d8105b20 msgr2=0x7f31d8105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.292+0000 7f31de800640 1 --2- 172.21.15.46:0/3914529732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d8105b20 0x7f31d8105fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009880 tx=0x7f31c002a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.292+0000 7f31de800640 1 -- 172.21.15.46:0/3914529732 shutdown_connections 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.292+0000 7f31de800640 1 --2- 172.21.15.46:0/3914529732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d8105b20 0x7f31d8105fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.292+0000 7f31de800640 1 --2- 172.21.15.46:0/3914529732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d81049c0 0x7f31d8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.292+0000 7f31de800640 1 -- 172.21.15.46:0/3914529732 >> 172.21.15.46:0/3914529732 conn(0x7f31d81002d0 msgr2=0x7f31d81026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.293+0000 7f31de800640 1 -- 172.21.15.46:0/3914529732 shutdown_connections 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.293+0000 7f31de800640 1 -- 172.21.15.46:0/3914529732 wait complete. 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.293+0000 7f31de800640 1 Processor -- start 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31de800640 1 -- start start 2024-09-10T22:56:27.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31de800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 0x7f31d80779a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31de800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d8105b20 0x7f31d8077ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31de800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f31d810d690 con 0x7f31d81049c0 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31de800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31d810d510 con 0x7f31d8105b20 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31d7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 0x7f31d80779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31d7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 0x7f31d80779a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49156/0 (socket says 172.21.15.46:49156) 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31d7400640 1 -- 172.21.15.46:0/1742516689 learned_addr learned my addr 172.21.15.46:0/1742516689 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31cfe00640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d8105b20 0x7f31d8077ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31d7400640 1 -- 172.21.15.46:0/1742516689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d8105b20 msgr2=0x7f31d8077ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31d7400640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d8105b20 0x7f31d8077ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31d7400640 1 -- 172.21.15.46:0/1742516689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d8078bc0 con 0x7f31d81049c0 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.294+0000 7f31cfe00640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d8105b20 0x7f31d8077ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.295+0000 7f31d7400640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 0x7f31d80779a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f31c800d8d0 tx=0x7f31c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.295+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31c8017070 con 0x7f31d81049c0 2024-09-10T22:56:27.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.295+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c8010460 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.295+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d8078eb0 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.295+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31c800f5f0 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.295+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d80794c0 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.296+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d810dde0 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.297+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f31c8010930 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.298+0000 7f31d4c00640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f31bc07a2d0 0x7f31bc07c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.298+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f31c809bb40 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.299+0000 7f31cfe00640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f31bc07a2d0 0x7f31bc07c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.299+0000 7f31cfe00640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f31bc07a2d0 0x7f31bc07c790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f31c0006010 tx=0x7f31c0000bc0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.302+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31c8064670 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.499+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f31d802e5c0 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.503+0000 7f31d4c00640 1 -- 172.21.15.46:0/1742516689 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7f31c8068a50 con 0x7f31d81049c0 2024-09-10T22:56:27.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f31bc07a2d0 msgr2=0x7f31bc07c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f31bc07a2d0 0x7f31bc07c790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f31c0006010 tx=0x7f31c0000bc0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 msgr2=0x7f31d80779a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 0x7f31d80779a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f31c800d8d0 tx=0x7f31c800dd90 comp rx=0 tx=0).stop 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 shutdown_connections 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f31bc07a2d0 0x7f31bc07c790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d8105b20 0x7f31d8077ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 --2- 172.21.15.46:0/1742516689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d81049c0 0x7f31d80779a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 >> 172.21.15.46:0/1742516689 conn(0x7f31d81002d0 msgr2=0x7f31d8109010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 shutdown_connections 2024-09-10T22:56:27.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:26.505+0000 7f31de800640 1 -- 172.21.15.46:0/1742516689 wait complete. 2024-09-10T22:56:27.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:27 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1742516689' entity='client.admin' 2024-09-10T22:56:28.601 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:28 smithi046 ceph-mon[28128]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:28.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:28 smithi073 ceph-mon[35473]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:28.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 -- 172.21.15.46:0/394124162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 msgr2=0x7f25c8103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:28.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 --2- 172.21.15.46:0/394124162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8103db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009880 tx=0x7f25b402a4b0 comp rx=0 tx=0).stop 2024-09-10T22:56:28.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 -- 172.21.15.46:0/394124162 shutdown_connections 2024-09-10T22:56:28.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 --2- 172.21.15.46:0/394124162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8103db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:28.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 --2- 172.21.15.46:0/394124162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c81027d0 0x7f25c8102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:28.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 -- 172.21.15.46:0/394124162 >> 172.21.15.46:0/394124162 conn(0x7f25c80fe0a0 msgr2=0x7f25c81004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:28.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 -- 172.21.15.46:0/394124162 shutdown_connections 2024-09-10T22:56:28.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.838+0000 7f25cfa00640 1 -- 172.21.15.46:0/394124162 wait complete. 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.839+0000 7f25cfa00640 1 Processor -- start 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25cfa00640 1 -- start start 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25cfa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c81027d0 0x7f25c81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25cfa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25cfa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f25c810b4c0 con 0x7f25c8103930 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25cfa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f25c810b340 con 0x7f25c81027d0 2024-09-10T22:56:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25c7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25c7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49188/0 (socket says 172.21.15.46:49188) 2024-09-10T22:56:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25c7e00640 1 -- 172.21.15.46:0/1363288902 learned_addr learned my addr 172.21.15.46:0/1363288902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.840+0000 7f25cd000640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c81027d0 0x7f25c81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c7e00640 1 -- 172.21.15.46:0/1363288902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c81027d0 msgr2=0x7f25c81982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c7e00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c81027d0 0x7f25c81982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c7e00640 1 -- 172.21.15.46:0/1363288902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c81994f0 con 0x7f25c8103930 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c7e00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8198920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f25b40099a0 tx=0x7f25b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25b403f070 con 0x7f25c8103930 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25b4004440 con 0x7f25c8103930 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c8199780 con 0x7f25c8103930 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.841+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25b4035030 con 0x7f25c8103930 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.842+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c8199d30 con 0x7f25c8103930 2024-09-10T22:56:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.843+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8102bd0 con 0x7f25c8103930 2024-09-10T22:56:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.844+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f25b4003c10 con 0x7f25c8103930 2024-09-10T22:56:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.845+0000 7f25c5600640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f25ac07a290 0x7f25ac07c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.845+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f25b40bcc70 con 0x7f25c8103930 2024-09-10T22:56:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.845+0000 7f25cd000640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f25ac07a290 0x7f25ac07c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.846+0000 7f25cd000640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f25ac07a290 0x7f25ac07c750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25b8005fd0 tx=0x7f25b800b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:28.849+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25b4089b00 con 0x7f25c8103930 2024-09-10T22:56:29.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.050+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f25c802e5c0 con 0x7f25c8103930 2024-09-10T22:56:29.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.054+0000 7f25c5600640 1 -- 172.21.15.46:0/1363288902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f25b408e520 con 0x7f25c8103930 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f25ac07a290 msgr2=0x7f25ac07c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f25ac07a290 0x7f25ac07c750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25b8005fd0 tx=0x7f25b800b390 comp rx=0 tx=0).stop 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 msgr2=0x7f25c8198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8198920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f25b40099a0 tx=0x7f25b4004040 comp rx=0 tx=0).stop 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 shutdown_connections 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f25ac07a290 0x7f25ac07c750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25c8103930 0x7f25c8198920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 --2- 172.21.15.46:0/1363288902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c81027d0 0x7f25c81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 >> 172.21.15.46:0/1363288902 conn(0x7f25c80fe0a0 msgr2=0x7f25c8106df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 shutdown_connections 2024-09-10T22:56:29.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:29.057+0000 7f25cfa00640 1 -- 172.21.15.46:0/1363288902 wait complete. 2024-09-10T22:56:30.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:30 smithi046 ceph-mon[28128]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:30.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:30 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1363288902' entity='client.admin' 2024-09-10T22:56:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:30 smithi073 ceph-mon[35473]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:30 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1363288902' entity='client.admin' 2024-09-10T22:56:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 -- 172.21.15.46:0/2015140291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 msgr2=0x7fef7c078ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 --2- 172.21.15.46:0/2015140291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c078ff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef68009880 tx=0x7fef6802a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 -- 172.21.15.46:0/2015140291 shutdown_connections 2024-09-10T22:56:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 --2- 172.21.15.46:0/2015140291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c078ff0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 --2- 172.21.15.46:0/2015140291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c077a10 0x7fef7c077e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 -- 172.21.15.46:0/2015140291 >> 172.21.15.46:0/2015140291 conn(0x7fef7c1000e0 msgr2=0x7fef7c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 -- 172.21.15.46:0/2015140291 shutdown_connections 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.266+0000 7fef7be00640 1 -- 172.21.15.46:0/2015140291 wait complete. 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.267+0000 7fef7be00640 1 Processor -- start 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.267+0000 7fef7be00640 1 -- start start 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.267+0000 7fef7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c077a10 0x7fef7c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1118e0 con 0x7fef7c078b70 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c111760 con 0x7fef7c077a10 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:30.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c19ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49212/0 (socket says 172.21.15.46:49212) 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7a000640 1 -- 172.21.15.46:0/1368851926 learned_addr learned my addr 172.21.15.46:0/1368851926 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7aa00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c077a10 0x7fef7c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7a000640 1 -- 172.21.15.46:0/1368851926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c077a10 msgr2=0x7fef7c19e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7a000640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c077a10 0x7fef7c19e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.268+0000 7fef7a000640 1 -- 172.21.15.46:0/1368851926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c19f930 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.269+0000 7fef7a000640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c19ed60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fef680099a0 tx=0x7fef68004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.269+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef6803f070 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.269+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef68004440 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.269+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef68035030 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.269+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c19fbc0 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.269+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c1a0170 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.270+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7c077e10 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.271+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fef68003c10 con 0x7fef7c078b70 2024-09-10T22:56:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.272+0000 7fef73400640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fef6007a290 0x7fef6007c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.272+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fef680bcc70 con 0x7fef7c078b70 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.273+0000 7fef7aa00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fef6007a290 0x7fef6007c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.273+0000 7fef7aa00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fef6007a290 0x7fef6007c750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fef6c005fd0 tx=0x7fef6c00b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.276+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fef68089b00 con 0x7fef7c078b70 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.475+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fef7c1a0420 con 0x7fef7c078b70 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.479+0000 7fef73400640 1 -- 172.21.15.46:0/1368851926 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7fef6808e520 con 0x7fef7c078b70 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fef6007a290 msgr2=0x7fef6007c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fef6007a290 0x7fef6007c750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fef6c005fd0 tx=0x7fef6c00b390 comp rx=0 tx=0).stop 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 msgr2=0x7fef7c19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c19ed60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fef680099a0 tx=0x7fef68004040 comp rx=0 tx=0).stop 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 shutdown_connections 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fef6007a290 0x7fef6007c750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.481+0000 7fef7be00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef7c078b70 0x7fef7c19ed60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.482+0000 7fef7be00640 1 --2- 172.21.15.46:0/1368851926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c077a10 0x7fef7c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.482+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 >> 172.21.15.46:0/1368851926 conn(0x7fef7c1000e0 msgr2=0x7fef7c10fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.482+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 shutdown_connections 2024-09-10T22:56:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:30.482+0000 7fef7be00640 1 -- 172.21.15.46:0/1368851926 wait complete. 2024-09-10T22:56:31.743 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:31 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1368851926' entity='client.admin' 2024-09-10T22:56:31.743 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:31.751 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:31.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:31 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1368851926' entity='client.admin' 2024-09-10T22:56:31.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:32.565 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:32 smithi046 ceph-mon[28128]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:32.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:32 smithi073 ceph-mon[35473]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:33.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.562+0000 7fc6f0200640 1 -- 172.21.15.46:0/2097929596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 msgr2=0x7fc6e8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:33.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.562+0000 7fc6f0200640 1 --2- 172.21.15.46:0/2097929596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e8075f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009880 tx=0x7fc6d402a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.563+0000 7fc6f0200640 1 -- 172.21.15.46:0/2097929596 shutdown_connections 2024-09-10T22:56:33.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.563+0000 7fc6f0200640 1 --2- 172.21.15.46:0/2097929596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e8075f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.563+0000 7fc6f0200640 1 --2- 172.21.15.46:0/2097929596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e8076f00 0x7fc6e8075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.563+0000 7fc6f0200640 1 -- 172.21.15.46:0/2097929596 >> 172.21.15.46:0/2097929596 conn(0x7fc6e80fe0a0 msgr2=0x7fc6e81004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.563+0000 7fc6f0200640 1 -- 172.21.15.46:0/2097929596 shutdown_connections 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.563+0000 7fc6f0200640 1 -- 172.21.15.46:0/2097929596 wait complete. 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6f0200640 1 Processor -- start 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6f0200640 1 -- start start 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6f0200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6f0200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e8076f00 0x7fc6e819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6f0200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e810d6c0 con 0x7fc6e8075aa0 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6f0200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e810d540 con 0x7fc6e8076f00 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6ed800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6ed800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49222/0 (socket says 172.21.15.46:49222) 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.564+0000 7fc6ed800640 1 -- 172.21.15.46:0/1176491514 learned_addr learned my addr 172.21.15.46:0/1176491514 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:33.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6ece00640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e8076f00 0x7fc6e819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6ed800640 1 -- 172.21.15.46:0/1176491514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e8076f00 msgr2=0x7fc6e819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6ed800640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e8076f00 0x7fc6e819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6ed800640 1 -- 172.21.15.46:0/1176491514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e819b710 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6ed800640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e819a4f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e970 tx=0x7fc6dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc00cac0 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6dc0054b0 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc004c40 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.565+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e819ba00 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.566+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e819c010 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.567+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e810de10 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.568+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fc6dc00cc60 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.569+0000 7fc6e6000640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc6d007a2d0 0x7fc6d007c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.569+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc6dc09c2e0 con 0x7fc6e8075aa0 2024-09-10T22:56:33.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.569+0000 7fc6ece00640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc6d007a2d0 0x7fc6d007c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.569+0000 7fc6ece00640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc6d007a2d0 0x7fc6d007c790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4000c00 tx=0x7fc6d4004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.573+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6dc064e10 con 0x7fc6e8075aa0 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.768+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc6e819c320 con 0x7fc6e8075aa0 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.772+0000 7fc6e6000640 1 -- 172.21.15.46:0/1176491514 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7fc6dc0691f0 con 0x7fc6e8075aa0 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc6d007a2d0 msgr2=0x7fc6d007c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc6d007a2d0 0x7fc6d007c790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4000c00 tx=0x7fc6d4004d70 comp rx=0 tx=0).stop 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 msgr2=0x7fc6e819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e819a4f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e970 tx=0x7fc6dc00ed70 comp rx=0 tx=0).stop 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 shutdown_connections 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc6d007a2d0 0x7fc6d007c790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e8076f00 0x7fc6e819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 --2- 172.21.15.46:0/1176491514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6e8075aa0 0x7fc6e819a4f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 >> 172.21.15.46:0/1176491514 conn(0x7fc6e80fe0a0 msgr2=0x7fc6e8108930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 shutdown_connections 2024-09-10T22:56:33.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:32.774+0000 7fc6f0200640 1 -- 172.21.15.46:0/1176491514 wait complete. 2024-09-10T22:56:34.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1176491514' entity='client.admin' 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:33 smithi046 ceph-mon[28128]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1176491514' entity='client.admin' 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:33 smithi073 ceph-mon[35473]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 -- 172.21.15.46:0/1686029603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c81027d0 msgr2=0x7f36c8102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 --2- 172.21.15.46:0/1686029603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c81027d0 0x7f36c8102bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009880 tx=0x7f36bc02a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 -- 172.21.15.46:0/1686029603 shutdown_connections 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 --2- 172.21.15.46:0/1686029603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c8103930 0x7f36c8103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 --2- 172.21.15.46:0/1686029603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c81027d0 0x7f36c8102bd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 -- 172.21.15.46:0/1686029603 >> 172.21.15.46:0/1686029603 conn(0x7f36c80fe0a0 msgr2=0x7f36c81004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 -- 172.21.15.46:0/1686029603 shutdown_connections 2024-09-10T22:56:34.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.684+0000 7f36d0200640 1 -- 172.21.15.46:0/1686029603 wait complete. 2024-09-10T22:56:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.685+0000 7f36d0200640 1 Processor -- start 2024-09-10T22:56:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.685+0000 7f36d0200640 1 -- start start 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36d0200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 0x7f36c81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36d0200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 0x7f36c8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36d0200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f36c810b4a0 con 0x7f36c8103930 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36d0200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f36c810b320 con 0x7f36c81027d0 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36cce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 0x7f36c8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36cd800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 0x7f36c81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36cd800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 0x7f36c81982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:36746/0 (socket says 172.21.15.46:36746) 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36cd800640 1 -- 172.21.15.46:0/152684219 learned_addr learned my addr 172.21.15.46:0/152684219 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.686+0000 7f36cce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 0x7f36c8198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40008/0 (socket says 172.21.15.46:40008) 2024-09-10T22:56:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36cce00640 1 -- 172.21.15.46:0/152684219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 msgr2=0x7f36c81982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36cce00640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 0x7f36c81982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36cce00640 1 -- 172.21.15.46:0/152684219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c81994e0 con 0x7f36c8103930 2024-09-10T22:56:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36cd800640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 0x7f36c81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:56:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36cce00640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 0x7f36c8198910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36b400c8f0 tx=0x7f36b400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36b400ae60 con 0x7f36c8103930 2024-09-10T22:56:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b4007e40 con 0x7f36c8103930 2024-09-10T22:56:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36b4004b30 con 0x7f36c8103930 2024-09-10T22:56:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c81997d0 con 0x7f36c8103930 2024-09-10T22:56:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.687+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c8199de0 con 0x7f36c8103930 2024-09-10T22:56:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.689+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c8102bd0 con 0x7f36c8103930 2024-09-10T22:56:34.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.690+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f36b40052d0 con 0x7f36c8103930 2024-09-10T22:56:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.691+0000 7f36c6000640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f36b007a2d0 0x7f36b007c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.691+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f36b409bb00 con 0x7f36c8103930 2024-09-10T22:56:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.691+0000 7f36cd800640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f36b007a2d0 0x7f36b007c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.692+0000 7f36cd800640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f36b007a2d0 0x7f36b007c790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009230 tx=0x7f36bc0058d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:34.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.695+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36b4014030 con 0x7f36c8103930 2024-09-10T22:56:34.844 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi046') 2024-09-10T22:56:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.899+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f36c8191c90 con 0x7f36c8103930 2024-09-10T22:56:34.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.903+0000 7f36c6000640 1 -- 172.21.15.46:0/152684219 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v26)=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f36b4068a10 con 0x7f36c8103930 2024-09-10T22:56:34.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.905+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f36b007a2d0 msgr2=0x7f36b007c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.905+0000 7f36d0200640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f36b007a2d0 0x7f36b007c790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009230 tx=0x7f36bc0058d0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.905+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 msgr2=0x7f36c8198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.905+0000 7f36d0200640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 0x7f36c8198910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36b400c8f0 tx=0x7f36b400cdb0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 shutdown_connections 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f36b007a2d0 0x7f36b007c790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c8103930 0x7f36c8198910 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 --2- 172.21.15.46:0/152684219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c81027d0 0x7f36c81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 >> 172.21.15.46:0/152684219 conn(0x7f36c80fe0a0 msgr2=0x7f36c8106e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 shutdown_connections 2024-09-10T22:56:34.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:34.906+0000 7f36d0200640 1 -- 172.21.15.46:0/152684219 wait complete. 2024-09-10T22:56:35.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 -- 172.21.15.46:0/3255195070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 msgr2=0x7f3518105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 --2- 172.21.15.46:0/3255195070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f3518105dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3504009880 tx=0x7f350402a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 -- 172.21.15.46:0/3255195070 shutdown_connections 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 --2- 172.21.15.46:0/3255195070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f3518105dd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 --2- 172.21.15.46:0/3255195070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 0x7f3518104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 -- 172.21.15.46:0/3255195070 >> 172.21.15.46:0/3255195070 conn(0x7f35181000e0 msgr2=0x7f3518102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 -- 172.21.15.46:0/3255195070 shutdown_connections 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.054+0000 7f3517200640 1 -- 172.21.15.46:0/3255195070 wait complete. 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.055+0000 7f3517200640 1 Processor -- start 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.055+0000 7f3517200640 1 -- start start 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3517200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 0x7f351819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3517200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f351819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3517200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f351810d4e0 con 0x7f3518105950 2024-09-10T22:56:35.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3517200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f351810d360 con 0x7f35181047f0 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f351819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f351819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40032/0 (socket says 172.21.15.46:40032) 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515400640 1 -- 172.21.15.46:0/900815505 learned_addr learned my addr 172.21.15.46:0/900815505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515e00640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 0x7f351819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515400640 1 -- 172.21.15.46:0/900815505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 msgr2=0x7f351819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515400640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 0x7f351819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515400640 1 -- 172.21.15.46:0/900815505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351819b510 con 0x7f3518105950 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.056+0000 7f3515e00640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 0x7f351819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.057+0000 7f3515400640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f351819a940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35040099a0 tx=0x7f3504005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.057+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f350403f070 con 0x7f3518105950 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.057+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3504004350 con 0x7f3518105950 2024-09-10T22:56:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.057+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351819b7a0 con 0x7f3518105950 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.057+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3504035030 con 0x7f3518105950 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.057+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351819bd50 con 0x7f3518105950 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.058+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3518104bf0 con 0x7f3518105950 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.059+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f3504003b10 con 0x7f3518105950 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.060+0000 7f350ea00640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f34fc07a290 0x7f34fc07c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.060+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f35040bcb80 con 0x7f3518105950 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.061+0000 7f3515e00640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f34fc07a290 0x7f34fc07c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.061+0000 7f3515e00640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f34fc07a290 0x7f34fc07c750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3508009fc0 tx=0x7f3508005f90 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:35.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.064+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3504089a10 con 0x7f3518105950 2024-09-10T22:56:35.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.267+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f351802e5c0 con 0x7f3518105950 2024-09-10T22:56:35.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.270+0000 7f350ea00640 1 -- 172.21.15.46:0/900815505 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f350408e430 con 0x7f3518105950 2024-09-10T22:56:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f34fc07a290 msgr2=0x7f34fc07c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f34fc07a290 0x7f34fc07c750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3508009fc0 tx=0x7f3508005f90 comp rx=0 tx=0).stop 2024-09-10T22:56:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 msgr2=0x7f351819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f351819a940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35040099a0 tx=0x7f3504005dc0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 shutdown_connections 2024-09-10T22:56:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f34fc07a290 0x7f34fc07c750 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518105950 0x7f351819a940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 --2- 172.21.15.46:0/900815505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35181047f0 0x7f351819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 >> 172.21.15.46:0/900815505 conn(0x7f35181000e0 msgr2=0x7f3518109e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.273+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 shutdown_connections 2024-09-10T22:56:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:35.274+0000 7f3517200640 1 -- 172.21.15.46:0/900815505 wait complete. 2024-09-10T22:56:36.003 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:35 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/152684219' entity='client.admin' 2024-09-10T22:56:36.003 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:35 smithi046 ceph-mon[28128]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:36.003 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:35 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/900815505' entity='client.admin' 2024-09-10T22:56:36.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:35 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/152684219' entity='client.admin' 2024-09-10T22:56:36.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:35 smithi073 ceph-mon[35473]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:36.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:35 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/900815505' entity='client.admin' 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 -- 172.21.15.46:0/4128533685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d941025f0 msgr2=0x7f4d941029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 --2- 172.21.15.46:0/4128533685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d941025f0 0x7f4d941029f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009880 tx=0x7f4d8402a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 -- 172.21.15.46:0/4128533685 shutdown_connections 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 --2- 172.21.15.46:0/4128533685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d94103750 0x7f4d94103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 --2- 172.21.15.46:0/4128533685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d941025f0 0x7f4d941029f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 -- 172.21.15.46:0/4128533685 >> 172.21.15.46:0/4128533685 conn(0x7f4d940fdec0 msgr2=0x7f4d94100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:36.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 -- 172.21.15.46:0/4128533685 shutdown_connections 2024-09-10T22:56:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.219+0000 7f4d93200640 1 -- 172.21.15.46:0/4128533685 wait complete. 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.220+0000 7f4d93200640 1 Processor -- start 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.220+0000 7f4d93200640 1 -- start start 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.220+0000 7f4d93200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 0x7f4d9419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.220+0000 7f4d93200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d94103750 0x7f4d9419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.220+0000 7f4d93200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410b340 con 0x7f4d94103750 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.220+0000 7f4d93200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410b1c0 con 0x7f4d941025f0 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d94103750 0x7f4d9419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 0x7f4d9419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 0x7f4d9419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:36780/0 (socket says 172.21.15.46:36780) 2024-09-10T22:56:36.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 -- 172.21.15.46:0/4205278856 learned_addr learned my addr 172.21.15.46:0/4205278856 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 -- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d94103750 msgr2=0x7f4d9419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d94103750 0x7f4d9419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 -- 172.21.15.46:0/4205278856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9419b5e0 con 0x7f4d941025f0 2024-09-10T22:56:36.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91400640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d94103750 0x7f4d9419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.221+0000 7f4d91e00640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 0x7f4d9419a3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009230 tx=0x7f4d84004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.222+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d8403f070 con 0x7f4d941025f0 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.222+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d840052d0 con 0x7f4d941025f0 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.222+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d84035030 con 0x7f4d941025f0 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.222+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9419b870 con 0x7f4d941025f0 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.222+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9419be20 con 0x7f4d941025f0 2024-09-10T22:56:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.223+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9410ba90 con 0x7f4d941025f0 2024-09-10T22:56:36.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.224+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f4d84003c30 con 0x7f4d941025f0 2024-09-10T22:56:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.225+0000 7f4d8aa00640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4d7807a2d0 0x7f4d7807c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.225+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4d840bd7e0 con 0x7f4d941025f0 2024-09-10T22:56:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.226+0000 7f4d91400640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4d7807a2d0 0x7f4d7807c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.226+0000 7f4d91400640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4d7807a2d0 0x7f4d7807c790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009d60 tx=0x7f4d80009110 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:36.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.233+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4d84086310 con 0x7f4d941025f0 2024-09-10T22:56:36.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.430+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f4d9419c0d0 con 0x7f4d941025f0 2024-09-10T22:56:36.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.436+0000 7f4d8aa00640 1 -- 172.21.15.46:0/4205278856 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f4d9419c0d0 con 0x7f4d941025f0 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4d7807a2d0 msgr2=0x7f4d7807c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4d7807a2d0 0x7f4d7807c790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009d60 tx=0x7f4d80009110 comp rx=0 tx=0).stop 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 msgr2=0x7f4d9419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 0x7f4d9419a3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009230 tx=0x7f4d84004270 comp rx=0 tx=0).stop 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 shutdown_connections 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f4d7807a2d0 0x7f4d7807c790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d94103750 0x7f4d9419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 --2- 172.21.15.46:0/4205278856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d941025f0 0x7f4d9419a3c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 >> 172.21.15.46:0/4205278856 conn(0x7f4d940fdec0 msgr2=0x7f4d940ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 shutdown_connections 2024-09-10T22:56:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:36.439+0000 7f4d93200640 1 -- 172.21.15.46:0/4205278856 wait complete. 2024-09-10T22:56:36.579 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi046') 2024-09-10T22:56:36.579 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:37 smithi046 ceph-mon[28128]: from='client.? ' entity='client.admin' 2024-09-10T22:56:37.766 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.766 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.766 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.766 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.766 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.766 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.767 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.767 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi046') 2024-09-10T22:56:37.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:37 smithi073 ceph-mon[35473]: from='client.? ' entity='client.admin' 2024-09-10T22:56:38.545 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '52773b64-6fc7-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-10T22:56:38.546 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T22:56:38.546 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T22:56:38.546 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:56:38.585 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:56:38.585 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-09-10T22:56:38.661 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:56:38.661 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:38.661 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-10T22:56:38.661 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:38.662 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:38.662 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-10 22:55:22.802709706 +0000 2024-09-10T22:56:38.662 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-10 22:49:11.984803849 +0000 2024-09-10T22:56:38.662 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-10 22:49:11.984803849 +0000 2024-09-10T22:56:38.662 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-10 22:49:11.984803849 +0000 2024-09-10T22:56:38.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:56:38.711 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:38 smithi046 ceph-mon[28128]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:38.711 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:38.711 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:38.711 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:56:38.711 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-10T22:56:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-10T22:56:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000194235 s, 2.6 MB/s 2024-09-10T22:56:38.760 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:56:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:38 smithi073 ceph-mon[35473]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:56:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:38.837 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-09-10T22:56:38.916 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-10 22:55:22.803709695 +0000 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-10 22:49:12.484798819 +0000 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-10 22:49:12.484798819 +0000 2024-09-10T22:56:38.917 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-10 22:49:12.484798819 +0000 2024-09-10T22:56:38.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:56:39.010 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-10T22:56:39.010 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-10T22:56:39.010 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000179449 s, 2.9 MB/s 2024-09-10T22:56:39.013 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:56:39.049 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-10 22:55:22.803709695 +0000 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-10 22:49:12.988793750 +0000 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-10 22:49:12.988793750 +0000 2024-09-10T22:56:39.125 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-10 22:49:12.988793750 +0000 2024-09-10T22:56:39.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:56:39.222 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-10T22:56:39.222 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-10T22:56:39.222 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.00018011 s, 2.8 MB/s 2024-09-10T22:56:39.225 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:56:39.261 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-09-10T22:56:39.336 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-10 22:55:22.804709685 +0000 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-10 22:49:13.606787533 +0000 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-10 22:49:13.606787533 +0000 2024-09-10T22:56:39.337 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-10 22:49:13.606787533 +0000 2024-09-10T22:56:39.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:56:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-10T22:56:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-10T22:56:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000178138 s, 2.9 MB/s 2024-09-10T22:56:39.432 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:56:39.470 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T22:56:39.470 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:56:39.512 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:56:39.512 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-10T22:56:39.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:39 smithi046 ceph-mon[28128]: Reconfiguring crash.smithi046 (monmap changed)... 2024-09-10T22:56:39.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:39 smithi046 ceph-mon[28128]: Reconfiguring daemon crash.smithi046 on smithi046 2024-09-10T22:56:39.591 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 22:56:03.500155226 +0000 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 22:49:09.197879147 +0000 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 22:49:09.197879147 +0000 2024-09-10T22:56:39.592 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 22:49:09.197879147 +0000 2024-09-10T22:56:39.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:56:39.691 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T22:56:39.691 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T22:56:39.691 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00029226 s, 1.8 MB/s 2024-09-10T22:56:39.693 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:56:39.731 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-10T22:56:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 22:56:03.501155203 +0000 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 22:49:09.695867610 +0000 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 22:49:09.695867610 +0000 2024-09-10T22:56:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 22:49:09.695867610 +0000 2024-09-10T22:56:39.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:56:39.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:39 smithi073 ceph-mon[35473]: Reconfiguring crash.smithi046 (monmap changed)... 2024-09-10T22:56:39.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:39 smithi073 ceph-mon[35473]: Reconfiguring daemon crash.smithi046 on smithi046 2024-09-10T22:56:39.881 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T22:56:39.881 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T22:56:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000271272 s, 1.9 MB/s 2024-09-10T22:56:39.884 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:56:39.920 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-10T22:56:39.996 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:56:39.997 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:39.997 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-09-10T22:56:39.998 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:39.998 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:39.998 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 22:56:03.502155180 +0000 2024-09-10T22:56:39.998 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 22:49:10.188856190 +0000 2024-09-10T22:56:39.998 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 22:49:10.188856190 +0000 2024-09-10T22:56:39.998 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 22:49:10.188856190 +0000 2024-09-10T22:56:39.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:56:40.089 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T22:56:40.089 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T22:56:40.089 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000280815 s, 1.8 MB/s 2024-09-10T22:56:40.092 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:56:40.129 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-10T22:56:40.203 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 22:56:03.502155180 +0000 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 22:49:10.699844352 +0000 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 22:49:10.699844352 +0000 2024-09-10T22:56:40.204 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 22:49:10.699844352 +0000 2024-09-10T22:56:40.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:56:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T22:56:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T22:56:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000266646 s, 1.9 MB/s 2024-09-10T22:56:40.299 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:56:40.335 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2024-09-10T22:56:40.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:56:40.521 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:40 smithi046 ceph-mon[28128]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:40.522 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:40.522 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:40.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:40 smithi073 ceph-mon[35473]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:40.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:40 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:40.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:40 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:41 smithi046 ceph-mon[28128]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-09-10T22:56:41.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:41 smithi046 ceph-mon[28128]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-09-10T22:56:41.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:41 smithi073 ceph-mon[35473]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-09-10T22:56:41.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:41 smithi073 ceph-mon[35473]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-09-10T22:56:42.112 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:42.718 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:42 smithi046 ceph-mon[28128]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:42.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:42 smithi073 ceph-mon[35473]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:44.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:44 smithi046 ceph-mon[28128]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:44.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:44 smithi073 ceph-mon[35473]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:46.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:46 smithi046 ceph-mon[28128]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:46.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:46 smithi073 ceph-mon[35473]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:56:48.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:48 smithi046 ceph-mon[28128]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:48.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:48 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:48.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:48 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:48.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:48 smithi046 ceph-mon[28128]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-09-10T22:56:48.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:48 smithi046 ceph-mon[28128]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-09-10T22:56:48.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:48 smithi073 ceph-mon[35473]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:48.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:48 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:48.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:48 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:48.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:48 smithi073 ceph-mon[35473]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-09-10T22:56:48.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:48 smithi073 ceph-mon[35473]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-09-10T22:56:48.869 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:56:48.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-09-10T22:56:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:56:50.400 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:50 smithi046 ceph-mon[28128]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:50 smithi073 ceph-mon[35473]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 -- 172.21.15.46:0/4180155694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8102600 msgr2=0x7f10e8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 --2- 172.21.15.46:0/4180155694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8102600 0x7f10e8102a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009880 tx=0x7f10d802a4a0 comp rx=0 tx=0).stop 2024-09-10T22:56:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 -- 172.21.15.46:0/4180155694 shutdown_connections 2024-09-10T22:56:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 --2- 172.21.15.46:0/4180155694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8103760 0x7f10e8103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 --2- 172.21.15.46:0/4180155694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8102600 0x7f10e8102a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 -- 172.21.15.46:0/4180155694 >> 172.21.15.46:0/4180155694 conn(0x7f10e80fdef0 msgr2=0x7f10e8100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 -- 172.21.15.46:0/4180155694 shutdown_connections 2024-09-10T22:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.786+0000 7f10e7e00640 1 -- 172.21.15.46:0/4180155694 wait complete. 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.787+0000 7f10e7e00640 1 Processor -- start 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.787+0000 7f10e7e00640 1 -- start start 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.787+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8102600 0x7f10e819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 0x7f10e819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10e7e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810b2f0 con 0x7f10e8103760 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10e7e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810b170 con 0x7f10e8102600 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10de000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 0x7f10e819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10de000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 0x7f10e819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33432/0 (socket says 172.21.15.46:33432) 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10de000640 1 -- 172.21.15.46:0/1409163515 learned_addr learned my addr 172.21.15.46:0/1409163515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10e6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8102600 0x7f10e819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10de000640 1 -- 172.21.15.46:0/1409163515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8102600 msgr2=0x7f10e819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10de000640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8102600 0x7f10e819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.788+0000 7f10de000640 1 -- 172.21.15.46:0/1409163515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e819b530 con 0x7f10e8103760 2024-09-10T22:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.789+0000 7f10de000640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 0x7f10e819a960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f10d000e970 tx=0x7f10d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.789+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10d000cac0 con 0x7f10e8103760 2024-09-10T22:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.789+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10d00054b0 con 0x7f10e8103760 2024-09-10T22:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.789+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10d0004c40 con 0x7f10e8103760 2024-09-10T22:56:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.789+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e819b820 con 0x7f10e8103760 2024-09-10T22:56:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.789+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e819be30 con 0x7f10e8103760 2024-09-10T22:56:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.790+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e8102a00 con 0x7f10e8103760 2024-09-10T22:56:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.791+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f10d000cc60 con 0x7f10e8103760 2024-09-10T22:56:50.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.793+0000 7f10eca00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f10cc07a2d0 0x7f10cc07c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:56:50.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.793+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f10d009c2e0 con 0x7f10e8103760 2024-09-10T22:56:50.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.793+0000 7f10e6a00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f10cc07a2d0 0x7f10cc07c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:56:50.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.794+0000 7f10e6a00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f10cc07a2d0 0x7f10cc07c790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10d8000c00 tx=0x7f10d8004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:56:50.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:50.797+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10d0064e10 con 0x7f10e8103760 2024-09-10T22:56:51.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:56:51.005+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f10e8075bb0 con 0x7f10cc07a2d0 2024-09-10T22:56:51.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:56:51.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:56:51.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:51.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:56:51.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:56:51.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:56:52.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:52 smithi046 ceph-mon[28128]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:52.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:52 smithi046 ceph-mon[28128]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:56:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:52 smithi073 ceph-mon[35473]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:52 smithi073 ceph-mon[35473]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:56:54.517 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:54 smithi046 ceph-mon[28128]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:54.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:54 smithi073 ceph-mon[35473]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:55 smithi046 ceph-mon[28128]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:55 smithi046 ceph-mon[28128]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-10T22:56:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:55 smithi046 ceph-mon[28128]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-10T22:56:56.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:56.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:56:56.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:55 smithi073 ceph-mon[35473]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:56.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:55 smithi073 ceph-mon[35473]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-10T22:56:56.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:55 smithi073 ceph-mon[35473]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-10T22:56:57.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:56 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1843353648' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5460ef41-5ff6-4583-8410-9f83bcd495f8"} : dispatch 2024-09-10T22:56:57.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:56 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1843353648' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5460ef41-5ff6-4583-8410-9f83bcd495f8"}]': finished 2024-09-10T22:56:57.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:56 smithi046 ceph-mon[28128]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:56:57.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:56 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:56:57.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:56 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1843353648' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5460ef41-5ff6-4583-8410-9f83bcd495f8"} : dispatch 2024-09-10T22:56:57.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:56 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1843353648' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5460ef41-5ff6-4583-8410-9f83bcd495f8"}]': finished 2024-09-10T22:56:57.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:56 smithi073 ceph-mon[35473]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:56:57.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:56 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:56:58.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:57 smithi046 ceph-mon[28128]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:57 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/970003290' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:56:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:57 smithi073 ceph-mon[35473]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:56:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:57 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/970003290' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:57:00.218 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:56:59 smithi046 ceph-mon[28128]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:00.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:56:59 smithi073 ceph-mon[35473]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:01 smithi046 ceph-mon[28128]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:02.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:01 smithi073 ceph-mon[35473]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:02.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:04.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:03 smithi046 ceph-mon[28128]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:04.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:03 smithi073 ceph-mon[35473]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:06.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:05 smithi046 ceph-mon[28128]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:06.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:05 smithi073 ceph-mon[35473]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:08.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:08.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:08.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:08.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: Reconfiguring ceph-exporter.smithi073 (monmap changed)... 2024-09-10T22:57:08.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-10T22:57:08.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:08.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:08 smithi046 ceph-mon[28128]: Reconfiguring daemon ceph-exporter.smithi073 on smithi073 2024-09-10T22:57:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: Reconfiguring ceph-exporter.smithi073 (monmap changed)... 2024-09-10T22:57:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-10T22:57:08.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:08.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:08 smithi073 ceph-mon[35473]: Reconfiguring daemon ceph-exporter.smithi073 on smithi073 2024-09-10T22:57:09.385 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:57:09.386 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:09.386 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: Deploying daemon osd.0 on smithi046 2024-09-10T22:57:09.386 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:09.386 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:09.386 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:57:09.386 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:09.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:57:09.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:09.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: Deploying daemon osd.0 on smithi046 2024-09-10T22:57:09.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:09.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:09.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-10T22:57:09.395 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:10.241 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:10 smithi046 ceph-mon[28128]: Reconfiguring crash.smithi073 (monmap changed)... 2024-09-10T22:57:10.241 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:10 smithi046 ceph-mon[28128]: Reconfiguring daemon crash.smithi073 on smithi073 2024-09-10T22:57:10.241 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:10 smithi046 ceph-mon[28128]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:10.518 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:10 smithi073 ceph-mon[35473]: Reconfiguring crash.smithi073 (monmap changed)... 2024-09-10T22:57:10.518 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:10 smithi073 ceph-mon[35473]: Reconfiguring daemon crash.smithi073 on smithi073 2024-09-10T22:57:10.518 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:10 smithi073 ceph-mon[35473]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:11.749 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:11.749 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:11.749 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: Reconfiguring mgr.smithi073.lkiuuj (monmap changed)... 2024-09-10T22:57:11.749 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi073.lkiuuj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:57:11.749 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:57:11.750 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:11.750 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:11 smithi046 ceph-mon[28128]: Reconfiguring daemon mgr.smithi073.lkiuuj on smithi073 2024-09-10T22:57:11.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:11.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:11.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: Reconfiguring mgr.smithi073.lkiuuj (monmap changed)... 2024-09-10T22:57:11.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi073.lkiuuj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:57:11.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:57:11.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:11.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:11 smithi073 ceph-mon[35473]: Reconfiguring daemon mgr.smithi073.lkiuuj on smithi073 2024-09-10T22:57:12.610 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:12 smithi046 ceph-mon[28128]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:12.610 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:12.610 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:12.610 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:57:12.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:57:12.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:12.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:12 smithi073 ceph-mon[35473]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:12.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:12.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:12.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:57:12.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:57:12.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:13.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:13 smithi046 ceph-mon[28128]: Reconfiguring mon.smithi073 (monmap changed)... 2024-09-10T22:57:13.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:13 smithi046 ceph-mon[28128]: Reconfiguring daemon mon.smithi073 on smithi073 2024-09-10T22:57:13.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:13 smithi073 ceph-mon[35473]: Reconfiguring mon.smithi073 (monmap changed)... 2024-09-10T22:57:13.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:13 smithi073 ceph-mon[35473]: Reconfiguring daemon mon.smithi073 on smithi073 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"} : dispatch 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-10T22:57:14.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"} : dispatch 2024-09-10T22:57:14.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-10T22:57:14.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"} : dispatch 2024-09-10T22:57:14.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:57:14.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-10T22:57:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"} : dispatch 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"} : dispatch 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"} : dispatch 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:57:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:15.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T22:57:15.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T22:57:15.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T22:57:15.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T22:57:15.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T22:57:15.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T22:57:15.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:15 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T22:57:15.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T22:57:15.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T22:57:15.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T22:57:15.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T22:57:15.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T22:57:15.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T22:57:15.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:15 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T22:57:16.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:16 smithi073 ceph-mon[35473]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:16.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:16.864 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:16 smithi046 ceph-mon[28128]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:16.864 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:18.037 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.037 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.037 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.037 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:19.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:18 smithi046 ceph-mon[28128]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:19.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:18 smithi073 ceph-mon[35473]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:20.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:20 smithi046 ceph-mon[28128]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:21.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:20 smithi073 ceph-mon[35473]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:22.808 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:22.808 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:22.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:22.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:57:22.814 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:22.814 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:57:22.814 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:22.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:22.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:22.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:22.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:57:22.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:22.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:57:22.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:22.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.861+0000 7f10eca00640 1 -- 172.21.15.46:0/1409163515 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10e8075bb0 con 0x7f10cc07a2d0 2024-09-10T22:57:22.863 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f10cc07a2d0 msgr2=0x7f10cc07c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f10cc07a2d0 0x7f10cc07c790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10d8000c00 tx=0x7f10d8004d70 comp rx=0 tx=0).stop 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 msgr2=0x7f10e819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 0x7f10e819a960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f10d000e970 tx=0x7f10d000ed70 comp rx=0 tx=0).stop 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 shutdown_connections 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f10cc07a2d0 0x7f10cc07c790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e8103760 0x7f10e819a960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 --2- 172.21.15.46:0/1409163515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8102600 0x7f10e819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 >> 172.21.15.46:0/1409163515 conn(0x7f10e80fdef0 msgr2=0x7f10e80754a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:57:22.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 shutdown_connections 2024-09-10T22:57:22.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:22.865+0000 7f10e7e00640 1 -- 172.21.15.46:0/1409163515 wait complete. 2024-09-10T22:57:23.521 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T22:57:23.525 INFO:tasks.cephadm:Deploying osd.1 on smithi046 with /dev/vg_nvme/lv_3... 2024-09-10T22:57:23.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:57:24.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:57:24.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:57:24.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:57:24.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:24.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:24.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:24.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:24.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:57:24.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:57:24.076 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0[49431]: 2024-09-10T22:57:23.786+0000 7f5332c00640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T22:57:24.076 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:57:23 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0[49431]: 2024-09-10T22:57:23.790+0000 7f532dc00640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:57:24.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:57:24.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:57:24.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:57:24.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:24.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:24.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:24.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:24.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:57:24.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:23 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-10T22:57:24.382 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: from='osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] boot 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:25.953 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:25.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:25 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:26.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T22:57:26.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T22:57:26.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: osd.0 [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] boot 2024-09-10T22:57:26.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T22:57:26.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:57:26.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:57:26.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:26.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:25 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:26.944 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:26 smithi046 ceph-mon[28128]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T22:57:27.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:26 smithi073 ceph-mon[35473]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T22:57:28.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:27 smithi046 ceph-mon[28128]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:28.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:27 smithi073 ceph-mon[35473]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:28.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:57:28.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-09-10T22:57:28.801 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 -- 172.21.15.46:0/3079390045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 msgr2=0x7f6090105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 --2- 172.21.15.46:0/3079390045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f6090105fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f607c009880 tx=0x7f607c02a4a0 comp rx=0 tx=0).stop 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 -- 172.21.15.46:0/3079390045 shutdown_connections 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 --2- 172.21.15.46:0/3079390045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f6090105fa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 --2- 172.21.15.46:0/3079390045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 0x7f6090104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 -- 172.21.15.46:0/3079390045 >> 172.21.15.46:0/3079390045 conn(0x7f60901002d0 msgr2=0x7f60901026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 -- 172.21.15.46:0/3079390045 shutdown_connections 2024-09-10T22:57:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.665+0000 7f6097c00640 1 -- 172.21.15.46:0/3079390045 wait complete. 2024-09-10T22:57:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.666+0000 7f6097c00640 1 Processor -- start 2024-09-10T22:57:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.666+0000 7f6097c00640 1 -- start start 2024-09-10T22:57:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f6097c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 0x7f609019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:57:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f6097c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f609019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f6097c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f609010d6b0 con 0x7f6090105b20 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f6097c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f609010d530 con 0x7f60901049c0 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f608fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f609019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f6095200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 0x7f609019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f608fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f609019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40980/0 (socket says 172.21.15.46:40980) 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f608fe00640 1 -- 172.21.15.46:0/1776324642 learned_addr learned my addr 172.21.15.46:0/1776324642 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f608fe00640 1 -- 172.21.15.46:0/1776324642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 msgr2=0x7f609019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.667+0000 7f608fe00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 0x7f609019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f608fe00640 1 -- 172.21.15.46:0/1776324642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609019b6c0 con 0x7f6090105b20 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f6095200640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 0x7f609019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:57:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f608fe00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f609019aaf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f607c0099a0 tx=0x7f607c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f607c03f070 con 0x7f6090105b20 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f607c004440 con 0x7f6090105b20 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609019b950 con 0x7f6090105b20 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f607c035030 con 0x7f6090105b20 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.668+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609019bf00 con 0x7f6090105b20 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.669+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6090104dc0 con 0x7f6090105b20 2024-09-10T22:57:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.670+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7f607c003c10 con 0x7f6090105b20 2024-09-10T22:57:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.672+0000 7f608d600640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f607807a290 0x7f607807c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:57:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.672+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f607c0bced0 con 0x7f6090105b20 2024-09-10T22:57:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.672+0000 7f6095200640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f607807a290 0x7f607807c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:57:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.673+0000 7f6095200640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f607807a290 0x7f607807c750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6084005fd0 tx=0x7f608400b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:57:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.676+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f607c089b00 con 0x7f6090105b20 2024-09-10T22:57:29.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:29.890+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6090063590 con 0x7f607807a290 2024-09-10T22:57:30.221 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:29 smithi046 ceph-mon[28128]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:30.221 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:57:30.221 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:57:30.221 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:29 smithi073 ceph-mon[35473]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:57:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:57:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:31.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:31 smithi046 ceph-mon[28128]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:57:31.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:31.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:31.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:31.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:31 smithi073 ceph-mon[35473]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:57:31.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:31.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:31.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:32.739 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:32 smithi046 ceph-mon[28128]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:32.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:32 smithi073 ceph-mon[35473]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:34.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:34 smithi046 ceph-mon[28128]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:34.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:34 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/792832936' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294d3916-f4c1-42a6-bfd4-7430ca8b8c4f"} : dispatch 2024-09-10T22:57:34.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:34 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/792832936' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294d3916-f4c1-42a6-bfd4-7430ca8b8c4f"}]': finished 2024-09-10T22:57:34.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:34 smithi046 ceph-mon[28128]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:57:34.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:57:34.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:34 smithi073 ceph-mon[35473]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:34.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:34 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/792832936' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294d3916-f4c1-42a6-bfd4-7430ca8b8c4f"} : dispatch 2024-09-10T22:57:34.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:34 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/792832936' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294d3916-f4c1-42a6-bfd4-7430ca8b8c4f"}]': finished 2024-09-10T22:57:34.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:34 smithi073 ceph-mon[35473]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:57:34.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:57:35.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:35 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2780076039' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:57:35.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:35 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2780076039' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:57:36.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:36 smithi046 ceph-mon[28128]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:36 smithi073 ceph-mon[35473]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:38.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:38 smithi046 ceph-mon[28128]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:38 smithi073 ceph-mon[35473]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:40.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:40 smithi046 ceph-mon[28128]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:40.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:40 smithi073 ceph-mon[35473]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi046 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi046 to 11846M 2024-09-10T22:57:42.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.438 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:42.438 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:57:42.438 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.438 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:42.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:42.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi046 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi046 to 11846M 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:43.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:43 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:57:43.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:43 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:43.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:43 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:57:43.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:43 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:44.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:44 smithi046 ceph-mon[28128]: Deploying daemon osd.1 on smithi046 2024-09-10T22:57:44.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:44 smithi046 ceph-mon[28128]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:44.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:44 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:44.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:44 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:44.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:44 smithi073 ceph-mon[35473]: Deploying daemon osd.1 on smithi046 2024-09-10T22:57:44.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:44 smithi073 ceph-mon[35473]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:44.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:44 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:44.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:44 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:46.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:46 smithi046 ceph-mon[28128]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:46.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:46 smithi073 ceph-mon[35473]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:47.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:47.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:57:48.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:48 smithi046 ceph-mon[28128]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:48.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:48 smithi073 ceph-mon[35473]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:50.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:50 smithi046 ceph-mon[28128]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:50.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:50.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:50.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:50.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:57:50.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:50 smithi073 ceph-mon[35473]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:50 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:50 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:50 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:57:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:50 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:57:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:50 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:52 smithi046 ceph-mon[28128]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:52.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:52 smithi073 ceph-mon[35473]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:52 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:57:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:52 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:52 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:54.374 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:54 smithi046 ceph-mon[28128]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:54.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:54 smithi073 ceph-mon[35473]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:55.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:55.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:55.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:55.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:56 smithi046 ceph-mon[28128]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:56.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:56 smithi073 ceph-mon[35473]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.055+0000 7f608d600640 1 -- 172.21.15.46:0/1776324642 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6090063590 con 0x7f607807a290 2024-09-10T22:57:57.056 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 1 on host 'smithi046' 2024-09-10T22:57:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f607807a290 msgr2=0x7f607807c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:57:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f607807a290 0x7f607807c750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6084005fd0 tx=0x7f608400b390 comp rx=0 tx=0).stop 2024-09-10T22:57:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 msgr2=0x7f609019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f609019aaf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f607c0099a0 tx=0x7f607c004040 comp rx=0 tx=0).stop 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 shutdown_connections 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f607807a290 0x7f607807c750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6090105b20 0x7f609019aaf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 --2- 172.21.15.46:0/1776324642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60901049c0 0x7f609019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.057+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 >> 172.21.15.46:0/1776324642 conn(0x7f60901002d0 msgr2=0x7f6090109030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.058+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 shutdown_connections 2024-09-10T22:57:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:57:57.058+0000 7f6097c00640 1 -- 172.21.15.46:0/1776324642 wait complete. 2024-09-10T22:57:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:57 smithi046 ceph-mon[28128]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:57:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:57.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:57.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:57 smithi073 ceph-mon[35473]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:57:57.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:57.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:57:57.901 DEBUG:teuthology.orchestra.run.smithi046:osd.1> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T22:57:57.905 INFO:tasks.cephadm:Deploying osd.2 on smithi046 with /dev/vg_nvme/lv_2... 2024-09-10T22:57:57.906 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:57:58.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-mon[28128]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:58.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-mon[28128]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:57:58.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-mon[28128]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T22:57:58.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-mon[28128]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:57:58.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:57:58.825 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1[56796]: 2024-09-10T22:57:58.590+0000 7f4538800640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T22:57:58.825 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:57:58 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1[56796]: 2024-09-10T22:57:58.593+0000 7f4533800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:57:58.969 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:57:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:58 smithi073 ceph-mon[35473]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:57:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:58 smithi073 ceph-mon[35473]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:57:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:58 smithi073 ceph-mon[35473]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T22:57:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:58 smithi073 ceph-mon[35473]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:57:59.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:58 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:57:59.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:59 smithi046 ceph-mon[28128]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:57:59.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:59 smithi046 ceph-mon[28128]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T22:57:59.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:57:59.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:57:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:59 smithi073 ceph-mon[35473]: from='osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:58:00.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:59 smithi073 ceph-mon[35473]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T22:58:00.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:59 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:57:59 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T22:58:00.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T22:58:00.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:58:00.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] boot 2024-09-10T22:58:00.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T22:58:00.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:00.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: osd.1 [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] boot 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:00.895 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:01.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:01 smithi046 ceph-mon[28128]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T22:58:01.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:02.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:01 smithi073 ceph-mon[35473]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T22:58:02.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:02.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:02 smithi046 ceph-mon[28128]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:03.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:02 smithi073 ceph-mon[35473]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:03.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:58:03.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-09-10T22:58:04.323 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:58:04.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:04 smithi046 ceph-mon[28128]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:04.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:04 smithi073 ceph-mon[35473]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:04.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 -- 172.21.15.46:0/1522334798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 msgr2=0x7fe2fc104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:58:04.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 --2- 172.21.15.46:0/1522334798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc104dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009880 tx=0x7fe2ec02a4b0 comp rx=0 tx=0).stop 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 -- 172.21.15.46:0/1522334798 shutdown_connections 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 --2- 172.21.15.46:0/1522334798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2fc105b20 0x7fe2fc105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 --2- 172.21.15.46:0/1522334798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc104dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 -- 172.21.15.46:0/1522334798 >> 172.21.15.46:0/1522334798 conn(0x7fe2fc1002d0 msgr2=0x7fe2fc1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 -- 172.21.15.46:0/1522334798 shutdown_connections 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.898+0000 7fe300e00640 1 -- 172.21.15.46:0/1522334798 wait complete. 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.899+0000 7fe300e00640 1 Processor -- start 2024-09-10T22:58:04.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.899+0000 7fe300e00640 1 -- start start 2024-09-10T22:58:04.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.899+0000 7fe300e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:58:04.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.899+0000 7fe300e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2fc105b20 0x7fe2fc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.899+0000 7fe300e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc10d6b0 con 0x7fe2fc1049c0 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.899+0000 7fe300e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc10d530 con 0x7fe2fc105b20 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc19a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41396/0 (socket says 172.21.15.46:41396) 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 -- 172.21.15.46:0/2333550610 learned_addr learned my addr 172.21.15.46:0/2333550610 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9400640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2fc105b20 0x7fe2fc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 -- 172.21.15.46:0/2333550610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2fc105b20 msgr2=0x7fe2fc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2fc105b20 0x7fe2fc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 -- 172.21.15.46:0/2333550610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc19b6e0 con 0x7fe2fc1049c0 2024-09-10T22:58:04.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.900+0000 7fe2f9e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc19a530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0099a0 tx=0x7fe2ec004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:58:04.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.901+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec03f070 con 0x7fe2fc1049c0 2024-09-10T22:58:04.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.901+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2ec004440 con 0x7fe2fc1049c0 2024-09-10T22:58:04.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.901+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2fc19b970 con 0x7fe2fc1049c0 2024-09-10T22:58:04.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.901+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec035030 con 0x7fe2fc1049c0 2024-09-10T22:58:04.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.901+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2fc19bf20 con 0x7fe2fc1049c0 2024-09-10T22:58:04.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.902+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2fc10de00 con 0x7fe2fc1049c0 2024-09-10T22:58:04.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.904+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fe2ec003c10 con 0x7fe2fc1049c0 2024-09-10T22:58:04.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.906+0000 7fe2f2a00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2e007a320 0x7fe2e007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:58:04.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.906+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7fe2ec0bcfa0 con 0x7fe2fc1049c0 2024-09-10T22:58:04.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.906+0000 7fe2f9400640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2e007a320 0x7fe2e007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:58:04.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.907+0000 7fe2f9400640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2e007a320 0x7fe2e007c7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8005fd0 tx=0x7fe2e800b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:58:04.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:04.911+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe2ec089aa0 con 0x7fe2fc1049c0 2024-09-10T22:58:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:05.124+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe2fc063590 con 0x7fe2e007a320 2024-09-10T22:58:05.615 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:58:05.615 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:58:05.615 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:05.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:58:05.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:58:05.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='client.14378 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:06.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:06.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:06.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:06.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:06.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='client.14378 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:58:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:07.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:07.707 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:07 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi046 to 5923M 2024-09-10T22:58:08.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:07 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi046 to 5923M 2024-09-10T22:58:08.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:08 smithi046 ceph-mon[28128]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:08.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:08 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1012738110' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cfa1ba4-f5c8-4efc-b923-73a99fad468e"} : dispatch 2024-09-10T22:58:08.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:08 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1012738110' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cfa1ba4-f5c8-4efc-b923-73a99fad468e"}]': finished 2024-09-10T22:58:08.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:08 smithi046 ceph-mon[28128]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:58:08.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:08 smithi073 ceph-mon[35473]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:08 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1012738110' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cfa1ba4-f5c8-4efc-b923-73a99fad468e"} : dispatch 2024-09-10T22:58:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:08 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1012738110' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cfa1ba4-f5c8-4efc-b923-73a99fad468e"}]': finished 2024-09-10T22:58:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:08 smithi073 ceph-mon[35473]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:58:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:09.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:09 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/17355610' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:58:10.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:09 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/17355610' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:58:10.896 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:10 smithi073 ceph-mon[35473]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:10.939 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:10 smithi046 ceph-mon[28128]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:12.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:12 smithi046 ceph-mon[28128]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:12.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:12.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:12.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:12.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:12.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:12 smithi073 ceph-mon[35473]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:13.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:13.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:13.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:13.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:13.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:15.004 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:14 smithi046 ceph-mon[28128]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:15.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:14 smithi073 ceph-mon[35473]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:16.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:16 smithi073 ceph-mon[35473]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:16.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:16 smithi046 ceph-mon[28128]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:58:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:17 smithi046 ceph-mon[28128]: Deploying daemon osd.2 on smithi046 2024-09-10T22:58:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:58:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:18.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:17 smithi073 ceph-mon[35473]: Deploying daemon osd.2 on smithi046 2024-09-10T22:58:18.946 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:18 smithi046 ceph-mon[28128]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:19.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:18 smithi073 ceph-mon[35473]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:20.879 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:20 smithi046 ceph-mon[28128]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:21.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:20 smithi073 ceph-mon[35473]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:22.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:22 smithi046 ceph-mon[28128]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:23.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:22 smithi073 ceph-mon[35473]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:24 smithi046 ceph-mon[28128]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:24.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:24.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:24.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:24 smithi073 ceph-mon[35473]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:25.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:25.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:25.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:26.787 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:26 smithi046 ceph-mon[28128]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:27.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:26 smithi073 ceph-mon[35473]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:29.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:28 smithi046 ceph-mon[28128]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:29.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:28 smithi073 ceph-mon[35473]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:30.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.034+0000 7fe2f2a00640 1 -- 172.21.15.46:0/2333550610 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe2fc063590 con 0x7fe2e007a320 2024-09-10T22:58:30.036 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 2 on host 'smithi046' 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2e007a320 msgr2=0x7fe2e007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2e007a320 0x7fe2e007c7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8005fd0 tx=0x7fe2e800b390 comp rx=0 tx=0).stop 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 msgr2=0x7fe2fc19a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc19a530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0099a0 tx=0x7fe2ec004040 comp rx=0 tx=0).stop 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 shutdown_connections 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2e007a320 0x7fe2e007c7e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2fc105b20 0x7fe2fc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 --2- 172.21.15.46:0/2333550610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2fc1049c0 0x7fe2fc19a530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.036+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 >> 172.21.15.46:0/2333550610 conn(0x7fe2fc1002d0 msgr2=0x7fe2fc109050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.037+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 shutdown_connections 2024-09-10T22:58:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:30.037+0000 7fe300e00640 1 -- 172.21.15.46:0/2333550610 wait complete. 2024-09-10T22:58:30.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:30 smithi046 ceph-mon[28128]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:30.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:30 smithi046 ceph-mon[28128]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:58:30.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:30.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:30 smithi073 ceph-mon[35473]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:30 smithi073 ceph-mon[35473]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:58:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:30 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:30 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:31.398 DEBUG:teuthology.orchestra.run.smithi046:osd.2> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T22:58:31.402 INFO:tasks.cephadm:Deploying osd.3 on smithi046 with /dev/vg_nvme/lv_1... 2024-09-10T22:58:31.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:58:31.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-mon[28128]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:58:31.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-mon[28128]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T22:58:31.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-mon[28128]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:58:31.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:31.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:32.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:31 smithi073 ceph-mon[35473]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:58:32.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:31 smithi073 ceph-mon[35473]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T22:58:32.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:31 smithi073 ceph-mon[35473]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:58:32.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:32.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:58:32.324 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2[63618]: 2024-09-10T22:58:31.973+0000 7f8b55a00640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T22:58:32.324 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:31 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2[63618]: 2024-09-10T22:58:31.990+0000 7f8b4b000640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:33.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: from='osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724]' entity='osd.2' 2024-09-10T22:58:33.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:33.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:33.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:33.783 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:33 smithi046 ceph-mon[28128]: osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] boot 2024-09-10T22:58:33.783 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:33 smithi046 ceph-mon[28128]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T22:58:33.783 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:33.783 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:58:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:33 smithi073 ceph-mon[35473]: osd.2 [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] boot 2024-09-10T22:58:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:33 smithi073 ceph-mon[35473]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T22:58:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:58:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:58:34.981 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:34 smithi073 ceph-mon[35473]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:34.982 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:58:34.982 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:34 smithi073 ceph-mon[35473]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T22:58:34.982 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:58:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:34 smithi046 ceph-mon[28128]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:58:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:58:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:34 smithi046 ceph-mon[28128]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T22:58:35.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:58:36.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:35 smithi046 ceph-mon[28128]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:36.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:58:36.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:35 smithi046 ceph-mon[28128]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T22:58:36.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:35 smithi046 ceph-mon[28128]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:58:36.138 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65415]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:58:36.138 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65415]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.138 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.138 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65415]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.139 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65418]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:58:36.139 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65418]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.139 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.139 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65418]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T22:58:36.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:35 smithi073 ceph-mon[35473]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:36.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:58:36.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:35 smithi073 ceph-mon[35473]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T22:58:36.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:35 smithi073 ceph-mon[35473]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:58:36.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_1 2024-09-10T22:58:36.409 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65435]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:58:36.409 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65435]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.409 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.410 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65435]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.410 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:58:36.410 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.410 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.410 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65438]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.410 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:58:36.410 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.410 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.410 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65429]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.410 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65432]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65432]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65432]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65423]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65423]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65426]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65426]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 22:58:36 smithi046 sudo[65426]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:58:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38725]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:36.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38728]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:58:36.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38728]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:58:36.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:58:36.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:36 smithi073 sudo[38728]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:58:37.015 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:37.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:37 smithi046 ceph-mon[28128]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 -- 172.21.15.46:0/1595523399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 msgr2=0x7fe8cc105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1595523399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc105fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009880 tx=0x7fe8b802a4a0 comp rx=0 tx=0).stop 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 -- 172.21.15.46:0/1595523399 shutdown_connections 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1595523399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc105fa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1595523399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8cc1049c0 0x7fe8cc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 -- 172.21.15.46:0/1595523399 >> 172.21.15.46:0/1595523399 conn(0x7fe8cc1002d0 msgr2=0x7fe8cc1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 -- 172.21.15.46:0/1595523399 shutdown_connections 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.558+0000 7fe8d2200640 1 -- 172.21.15.46:0/1595523399 wait complete. 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.559+0000 7fe8d2200640 1 Processor -- start 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8d2200640 1 -- start start 2024-09-10T22:58:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8d2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8cc1049c0 0x7fe8cc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8d2200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8d2200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc10d690 con 0x7fe8cc105b20 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8d2200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc10d510 con 0x7fe8cc1049c0 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8caa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8caa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47458/0 (socket says 172.21.15.46:47458) 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8caa00640 1 -- 172.21.15.46:0/1167771279 learned_addr learned my addr 172.21.15.46:0/1167771279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.560+0000 7fe8cb400640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8cc1049c0 0x7fe8cc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.561+0000 7fe8caa00640 1 -- 172.21.15.46:0/1167771279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8cc1049c0 msgr2=0x7fe8cc19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.561+0000 7fe8caa00640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8cc1049c0 0x7fe8cc19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.561+0000 7fe8caa00640 1 -- 172.21.15.46:0/1167771279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc19b6b0 con 0x7fe8cc105b20 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.561+0000 7fe8caa00640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc19aae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80099a0 tx=0x7fe8b8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.561+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8b803f070 con 0x7fe8cc105b20 2024-09-10T22:58:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.562+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8b8004350 con 0x7fe8cc105b20 2024-09-10T22:58:37.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.562+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc19b940 con 0x7fe8cc105b20 2024-09-10T22:58:37.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.562+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8b8035030 con 0x7fe8cc105b20 2024-09-10T22:58:37.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.562+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc19bef0 con 0x7fe8cc105b20 2024-09-10T22:58:37.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.563+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc104dc0 con 0x7fe8cc105b20 2024-09-10T22:58:37.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.565+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 102424+0+0 (secure 0 0 0) 0x7fe8b8003b10 con 0x7fe8cc105b20 2024-09-10T22:58:37.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.566+0000 7fe8c3e00640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe8b007a2d0 0x7fe8b007c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:58:37.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.566+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3232+0+0 (secure 0 0 0) 0x7fe8b80bd1e0 con 0x7fe8cc105b20 2024-09-10T22:58:37.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.567+0000 7fe8cb400640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe8b007a2d0 0x7fe8b007c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:58:37.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.568+0000 7fe8cb400640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe8b007a2d0 0x7fe8b007c790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009bd0 tx=0x7fe8bc005f90 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:58:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.572+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe8b80899d0 con 0x7fe8cc105b20 2024-09-10T22:58:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:58:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:58:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:58:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:58:37.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:58:37.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-10T22:58:37.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-09-10T22:58:37.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:58:37.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:37.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:37 smithi073 ceph-mon[35473]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T22:58:37.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.704+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fe8b8081210 con 0x7fe8cc105b20 2024-09-10T22:58:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:58:37.804+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe8cc063590 con 0x7fe8b007a2d0 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: pgmap v103: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: Cluster is now healthy 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: mgrmap e19: smithi046.eocvws(active, since 3m), standbys: smithi073.lkiuuj 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:58:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:38.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: pgmap v103: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:38.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T22:58:38.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: Cluster is now healthy 2024-09-10T22:58:38.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: mgrmap e19: smithi046.eocvws(active, since 3m), standbys: smithi073.lkiuuj 2024-09-10T22:58:38.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:58:38.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:58:38.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:39.994 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:58:39.994 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi046 2024-09-10T22:58:39.994 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:39.994 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:39.994 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:39.994 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi046 to 3948M 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:39.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:58:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi046 2024-09-10T22:58:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi046 to 3948M 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:58:40.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:40.964 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:40 smithi046 ceph-mon[28128]: pgmap v104: 1 pgs: 1 creating+activating; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:40 smithi073 ceph-mon[35473]: pgmap v104: 1 pgs: 1 creating+activating; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:42.041 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:41 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2437106471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8575c985-20a6-4edb-8186-e502888ef174"} : dispatch 2024-09-10T22:58:42.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:41 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2437106471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8575c985-20a6-4edb-8186-e502888ef174"}]': finished 2024-09-10T22:58:42.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:41 smithi046 ceph-mon[28128]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T22:58:42.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:58:42.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:41 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2437106471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8575c985-20a6-4edb-8186-e502888ef174"} : dispatch 2024-09-10T22:58:42.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:41 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2437106471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8575c985-20a6-4edb-8186-e502888ef174"}]': finished 2024-09-10T22:58:42.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:41 smithi073 ceph-mon[35473]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T22:58:42.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:58:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:42 smithi046 ceph-mon[28128]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:42 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3279296311' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:58:43.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:42 smithi073 ceph-mon[35473]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:43.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:42 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3279296311' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:58:45.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:44 smithi046 ceph-mon[28128]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:45.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:44 smithi073 ceph-mon[35473]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:47.045 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:46 smithi046 ceph-mon[28128]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:47.046 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:46 smithi073 ceph-mon[35473]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:58:49.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:48 smithi046 ceph-mon[28128]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:48 smithi073 ceph-mon[35473]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:50.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:58:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:58:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:58:51.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:50 smithi046 ceph-mon[28128]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:51.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:50 smithi046 ceph-mon[28128]: Deploying daemon osd.3 on smithi046 2024-09-10T22:58:51.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:50 smithi073 ceph-mon[35473]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:51.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:50 smithi073 ceph-mon[35473]: Deploying daemon osd.3 on smithi046 2024-09-10T22:58:51.997 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:51 smithi046 ceph-mon[28128]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:52.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:51 smithi073 ceph-mon[35473]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:54.300 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:53 smithi046 ceph-mon[28128]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:54.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:53 smithi073 ceph-mon[35473]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:56.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:55 smithi046 ceph-mon[28128]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:56.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:55 smithi073 ceph-mon[35473]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:58.035 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:57 smithi046 ceph-mon[28128]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:58.035 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:58.035 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:58.035 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:57 smithi073 ceph-mon[35473]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:58:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:58:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:58:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:00.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:58:59 smithi046 ceph-mon[28128]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:00.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:58:59 smithi073 ceph-mon[35473]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:01.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.325+0000 7fe8c3e00640 1 -- 172.21.15.46:0/1167771279 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe8cc063590 con 0x7fe8b007a2d0 2024-09-10T22:59:01.327 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 3 on host 'smithi046' 2024-09-10T22:59:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe8b007a2d0 msgr2=0x7fe8b007c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe8b007a2d0 0x7fe8b007c790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009bd0 tx=0x7fe8bc005f90 comp rx=0 tx=0).stop 2024-09-10T22:59:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 msgr2=0x7fe8cc19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc19aae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80099a0 tx=0x7fe8b8005dc0 comp rx=0 tx=0).stop 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 shutdown_connections 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe8b007a2d0 0x7fe8b007c790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8cc105b20 0x7fe8cc19aae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 --2- 172.21.15.46:0/1167771279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8cc1049c0 0x7fe8cc19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.327+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 >> 172.21.15.46:0/1167771279 conn(0x7fe8cc1002d0 msgr2=0x7fe8cc109010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.328+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 shutdown_connections 2024-09-10T22:59:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T22:59:01.328+0000 7fe8d2200640 1 -- 172.21.15.46:0/1167771279 wait complete. 2024-09-10T22:59:02.483 DEBUG:teuthology.orchestra.run.smithi046:osd.3> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T22:59:02.487 INFO:tasks.cephadm:Deploying osd.4 on smithi073 with /dev/vg_nvme/lv_4... 2024-09-10T22:59:02.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:59:02.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:02 smithi046 ceph-mon[28128]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:02.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:02.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:02.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:02.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:02 smithi046 ceph-mon[28128]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:59:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:02 smithi073 ceph-mon[35473]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:02 smithi073 ceph-mon[35473]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:59:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T22:59:03.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:03 smithi073 ceph-mon[35473]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:59:03.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:03 smithi073 ceph-mon[35473]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T22:59:03.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:03 smithi073 ceph-mon[35473]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:59:03.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:03 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:03.643 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:03 smithi046 ceph-mon[28128]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:59:03.643 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:03 smithi046 ceph-mon[28128]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T22:59:03.643 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:03 smithi046 ceph-mon[28128]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-10T22:59:03.643 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:03 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:04.036 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 22:59:03 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T22:59:03.640+0000 7fb231400640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T22:59:04.036 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 22:59:03 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T22:59:03.660+0000 7fb227400640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:59:04.604 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:04 smithi073 ceph-mon[35473]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:04.604 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:04 smithi073 ceph-mon[35473]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:59:04.604 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:04 smithi073 ceph-mon[35473]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T22:59:04.604 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:04.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:04.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:04 smithi073 ceph-mon[35473]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' 2024-09-10T22:59:04.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:04 smithi046 ceph-mon[28128]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:04.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:04 smithi046 ceph-mon[28128]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-10T22:59:04.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:04 smithi046 ceph-mon[28128]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T22:59:04.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:04 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:04.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:04 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:04.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:04 smithi046 ceph-mon[28128]: from='osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252]' entity='osd.3' 2024-09-10T22:59:05.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T22:59:05.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T22:59:05.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:05.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] boot 2024-09-10T22:59:05.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T22:59:05.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:05.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:05.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:05 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: osd.3 [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] boot 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:59:05.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:05.777 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:05 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:06.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:59:06.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-09-10T22:59:06.489 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T22:59:06.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:06 smithi046 ceph-mon[28128]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:06.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:06 smithi046 ceph-mon[28128]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T22:59:06.979 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:06 smithi073 ceph-mon[35473]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:59:06.979 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:06 smithi073 ceph-mon[35473]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T22:59:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 -- 172.21.15.73:0/2842094631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c1049c0 msgr2=0x7f712c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 --2- 172.21.15.73:0/2842094631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c1049c0 0x7f712c104dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f711c009880 tx=0x7f711c02a4a0 comp rx=0 tx=0).stop 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 -- 172.21.15.73:0/2842094631 shutdown_connections 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 --2- 172.21.15.73:0/2842094631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f712c105b20 0x7f712c105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 --2- 172.21.15.73:0/2842094631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c1049c0 0x7f712c104dc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 -- 172.21.15.73:0/2842094631 >> 172.21.15.73:0/2842094631 conn(0x7f712c1002d0 msgr2=0x7f712c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 -- 172.21.15.73:0/2842094631 shutdown_connections 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.090+0000 7f7132a00640 1 -- 172.21.15.73:0/2842094631 wait complete. 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.091+0000 7f7132a00640 1 Processor -- start 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.091+0000 7f7132a00640 1 -- start start 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.091+0000 7f7132a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f712c1049c0 0x7f712c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7132a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 0x7f712c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:59:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7132a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f712c10d6b0 con 0x7f712c1049c0 2024-09-10T22:59:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7132a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f712c10d530 con 0x7f712c105b20 2024-09-10T22:59:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 0x7f712c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:59:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 0x7f712c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41942/0 (socket says 172.21.15.73:41942) 2024-09-10T22:59:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 -- 172.21.15.73:0/2884302011 learned_addr learned my addr 172.21.15.73:0/2884302011 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T22:59:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f712be00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f712c1049c0 0x7f712c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:59:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 -- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f712c1049c0 msgr2=0x7f712c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f712c1049c0 0x7f712c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 -- 172.21.15.73:0/2884302011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712c19b700 con 0x7f712c105b20 2024-09-10T22:59:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.092+0000 7f7123e00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 0x7f712c19ab30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f711400e970 tx=0x7f711400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.093+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f711400cac0 con 0x7f712c105b20 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.093+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71140054b0 con 0x7f712c105b20 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.093+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7114004c40 con 0x7f712c105b20 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.093+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712c19b9f0 con 0x7f712c105b20 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.093+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f712c19c000 con 0x7f712c105b20 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.094+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712c104dc0 con 0x7f712c105b20 2024-09-10T22:59:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.095+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f711400cc60 con 0x7f712c105b20 2024-09-10T22:59:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.096+0000 7f7129600640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f711007a370 0x7f711007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:59:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.096+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3664+0+0 (secure 0 0 0) 0x7f711409cd80 con 0x7f712c105b20 2024-09-10T22:59:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.096+0000 7f712be00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f711007a370 0x7f711007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:59:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.097+0000 7f712be00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f711007a370 0x7f711007c830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f711c000c00 tx=0x7f711c004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:59:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.101+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7114064f00 con 0x7f712c105b20 2024-09-10T22:59:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:07.295+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f712c02e630 con 0x7f711007a370 2024-09-10T22:59:07.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:07 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:59:07.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:07 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:59:07.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:07 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:07.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:07 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:59:07.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:07 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:59:07.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:07 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:08.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:08 smithi046 ceph-mon[28128]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:08.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:08 smithi046 ceph-mon[28128]: from='client.24213 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:59:08.934 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:08 smithi073 ceph-mon[35473]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:08.934 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:08 smithi073 ceph-mon[35473]: from='client.24213 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:59:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi046 2024-09-10T22:59:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi046 to 2961M 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/1578766458' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee"} : dispatch 2024-09-10T22:59:10.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee"} : dispatch 2024-09-10T22:59:10.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee"}]': finished 2024-09-10T22:59:10.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:59:10.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi046 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:10.616 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi046 to 2961M 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/1578766458' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee"} : dispatch 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee"}]': finished 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:59:10.617 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:11 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3569884731' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:59:11.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:11 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/3569884731' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:59:12.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:12 smithi046 ceph-mon[28128]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:12.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:12 smithi073 ceph-mon[35473]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:14.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:14 smithi046 ceph-mon[28128]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:14 smithi073 ceph-mon[35473]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:16.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:16 smithi073 ceph-mon[35473]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:16.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:16.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:16 smithi046 ceph-mon[28128]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:16.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:18.554 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:18 smithi073 ceph-mon[35473]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:18.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:18 smithi046 ceph-mon[28128]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:19.473 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:19 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:59:19.474 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:19 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:19.474 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:19 smithi073 ceph-mon[35473]: Deploying daemon osd.4 on smithi073 2024-09-10T22:59:19.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:19 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:59:19.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:19 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:19.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:19 smithi046 ceph-mon[28128]: Deploying daemon osd.4 on smithi073 2024-09-10T22:59:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:20 smithi046 ceph-mon[28128]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:20.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:20 smithi073 ceph-mon[35473]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:22.632 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:22 smithi073 ceph-mon[35473]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:22.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:22 smithi046 ceph-mon[28128]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:24.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:24 smithi046 ceph-mon[28128]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:24.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:24 smithi073 ceph-mon[35473]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:26.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:26 smithi073 ceph-mon[35473]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:26.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:26 smithi046 ceph-mon[28128]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:27.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:27 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:59:27.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:27 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:27.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:27 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:27.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:27 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:59:27.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:27 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:27.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:27 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:28.777 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:28 smithi073 ceph-mon[35473]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:29.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:28 smithi046 ceph-mon[28128]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:30.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:30 smithi073 ceph-mon[35473]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:31.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:30 smithi046 ceph-mon[28128]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:31.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.784+0000 7f7129600640 1 -- 172.21.15.73:0/2884302011 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f712c02e630 con 0x7f711007a370 2024-09-10T22:59:31.786 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 4 on host 'smithi073' 2024-09-10T22:59:31.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.786+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f711007a370 msgr2=0x7f711007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.786+0000 7f7132a00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f711007a370 0x7f711007c830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f711c000c00 tx=0x7f711c004d70 comp rx=0 tx=0).stop 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.786+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 msgr2=0x7f712c19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.786+0000 7f7132a00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 0x7f712c19ab30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f711400e970 tx=0x7f711400ed70 comp rx=0 tx=0).stop 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 shutdown_connections 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f711007a370 0x7f711007c830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f712c105b20 0x7f712c19ab30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 --2- 172.21.15.73:0/2884302011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f712c1049c0 0x7f712c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 >> 172.21.15.73:0/2884302011 conn(0x7f712c1002d0 msgr2=0x7f712c108fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 shutdown_connections 2024-09-10T22:59:31.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:31.787+0000 7f7132a00640 1 -- 172.21.15.73:0/2884302011 wait complete. 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:32.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.016 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.016 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:32.533 DEBUG:teuthology.orchestra.run.smithi073:osd.4> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T22:59:32.537 INFO:tasks.cephadm:Deploying osd.5 on smithi073 with /dev/vg_nvme/lv_3... 2024-09-10T22:59:32.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:59:33.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:32 smithi073 ceph-mon[35473]: from='osd.4 [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:59:33.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:32 smithi073 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:59:33.229 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:59:33.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:32 smithi046 ceph-mon[28128]: from='osd.4 [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:59:33.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:32 smithi046 ceph-mon[28128]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:59:33.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:59:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T22:59:34.031 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:33 smithi073 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:59:34.031 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:33 smithi073 ceph-mon[35473]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T22:59:34.031 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:34.031 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:33 smithi073 ceph-mon[35473]: from='osd.4 [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T22:59:34.031 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:33 smithi073 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T22:59:34.032 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:33 smithi073 ceph-mon[35473]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:34.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:33 smithi046 ceph-mon[28128]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:59:34.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:33 smithi046 ceph-mon[28128]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T22:59:34.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:34.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:33 smithi046 ceph-mon[28128]: from='osd.4 [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T22:59:34.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:33 smithi046 ceph-mon[28128]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T22:59:34.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:33 smithi046 ceph-mon[28128]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:59:34.614 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T22:59:34.410+0000 7f01afe00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T22:59:34.632 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T22:59:34.422+0000 7f01a5e00640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: from='osd.4 ' entity='osd.4' 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: osd.4 [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] boot 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T22:59:35.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T22:59:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T22:59:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: from='osd.4 ' entity='osd.4' 2024-09-10T22:59:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: osd.4 [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] boot 2024-09-10T22:59:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T22:59:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:59:36.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:35 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T22:59:36.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:35 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T22:59:36.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:35 smithi073 ceph-mon[35473]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:36.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:35 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T22:59:36.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:35 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T22:59:36.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:35 smithi046 ceph-mon[28128]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:37.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:36 smithi073 ceph-mon[35473]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T22:59:37.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:36 smithi046 ceph-mon[28128]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 315 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi073 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi073 to 14913M 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:38.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:38.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T22:59:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 315 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi073 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi073 to 14913M 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:59:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T22:59:38.809 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T22:59:38.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-09-10T22:59:39.206 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T22:59:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.741+0000 7fd039e00640 1 -- 172.21.15.73:0/428582806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 msgr2=0x7fd03410a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.741+0000 7fd039e00640 1 --2- 172.21.15.73:0/428582806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03410a650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd024009880 tx=0x7fd02402a4a0 comp rx=0 tx=0).stop 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.741+0000 7fd039e00640 1 -- 172.21.15.73:0/428582806 shutdown_connections 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.741+0000 7fd039e00640 1 --2- 172.21.15.73:0/428582806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd034108f80 0x7fd034109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.741+0000 7fd039e00640 1 --2- 172.21.15.73:0/428582806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03410a650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.741+0000 7fd039e00640 1 -- 172.21.15.73:0/428582806 >> 172.21.15.73:0/428582806 conn(0x7fd034078140 msgr2=0x7fd03407a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.742+0000 7fd039e00640 1 -- 172.21.15.73:0/428582806 shutdown_connections 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.742+0000 7fd039e00640 1 -- 172.21.15.73:0/428582806 wait complete. 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.742+0000 7fd039e00640 1 Processor -- start 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd039e00640 1 -- start start 2024-09-10T22:59:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd039e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd034108f80 0x7fd03419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd039e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd039e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd034111ac0 con 0x7fd034108f80 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd039e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd034111940 con 0x7fd03410a250 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd032000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd032000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03419ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55424/0 (socket says 172.21.15.73:55424) 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd032000640 1 -- 172.21.15.73:0/206661676 learned_addr learned my addr 172.21.15.73:0/206661676 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.743+0000 7fd032a00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd034108f80 0x7fd03419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd032000640 1 -- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd034108f80 msgr2=0x7fd03419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd032000640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd034108f80 0x7fd03419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd032000640 1 -- 172.21.15.73:0/206661676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03419fb10 con 0x7fd03410a250 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd032000640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03419ef40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d6f0 tx=0x7fd02000dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:59:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd020017070 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd02000de00 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03419fe00 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0200049d0 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.744+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0341a0410 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.746+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd034109400 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.747+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fd020004c80 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.748+0000 7fd038a00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd01807a370 0x7fd01807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.748+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7fd02009c520 con 0x7fd03410a250 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.749+0000 7fd032a00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd01807a370 0x7fd01807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.749+0000 7fd032a00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd01807a370 0x7fd01807c830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd024000c00 tx=0x7fd024004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:59:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.753+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd020068840 con 0x7fd03410a250 2024-09-10T22:59:39.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T22:59:39.947+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd034063590 con 0x7fd01807a370 2024-09-10T22:59:40.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:39 smithi046 ceph-mon[28128]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:40.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:59:40.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:59:40.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:39 smithi073 ceph-mon[35473]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:59:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:59:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:40 smithi073 ceph-mon[35473]: from='client.24231 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:59:41.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:40 smithi046 ceph-mon[28128]: from='client.24231 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:59:42.089 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:41 smithi073 ceph-mon[35473]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:59:42.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:41 smithi046 ceph-mon[28128]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:59:43.308 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:42 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/355807079' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84431538-dde7-43ca-94c2-ec8a3ce72421"} : dispatch 2024-09-10T22:59:43.308 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:42 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84431538-dde7-43ca-94c2-ec8a3ce72421"} : dispatch 2024-09-10T22:59:43.308 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:42 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84431538-dde7-43ca-94c2-ec8a3ce72421"}]': finished 2024-09-10T22:59:43.309 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:42 smithi073 ceph-mon[35473]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T22:59:43.309 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:42 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:59:43.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:42 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/355807079' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84431538-dde7-43ca-94c2-ec8a3ce72421"} : dispatch 2024-09-10T22:59:43.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:42 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84431538-dde7-43ca-94c2-ec8a3ce72421"} : dispatch 2024-09-10T22:59:43.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:42 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84431538-dde7-43ca-94c2-ec8a3ce72421"}]': finished 2024-09-10T22:59:43.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:42 smithi046 ceph-mon[28128]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T22:59:43.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:59:44.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:44 smithi046 ceph-mon[28128]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-10T22:59:44.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:44 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2225005213' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:59:44.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:44 smithi073 ceph-mon[35473]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-10T22:59:44.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:44 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/2225005213' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:59:46.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:46 smithi046 ceph-mon[28128]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:59:46.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:46 smithi073 ceph-mon[35473]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:59:47.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:47.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T22:59:48.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:48 smithi046 ceph-mon[28128]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:59:48.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:48 smithi073 ceph-mon[35473]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:59:50.118 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:50 smithi073 ceph-mon[35473]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:59:50.218 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:50 smithi046 ceph-mon[28128]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:59:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:52 smithi046 ceph-mon[28128]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:59:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:52 smithi046 ceph-mon[28128]: Deploying daemon osd.5 on smithi073 2024-09-10T22:59:52.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:52 smithi073 ceph-mon[35473]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:52.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:52 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:59:52.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:52 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:59:52.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:52 smithi073 ceph-mon[35473]: Deploying daemon osd.5 on smithi073 2024-09-10T22:59:54.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:54 smithi046 ceph-mon[28128]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:54.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:54 smithi073 ceph-mon[35473]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:56.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:56 smithi073 ceph-mon[35473]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:56.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:56 smithi046 ceph-mon[28128]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:58.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 22:59:58 smithi073 ceph-mon[35473]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:59:58.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 22:59:58 smithi046 ceph-mon[28128]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:00 smithi073 ceph-mon[35473]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:00 smithi073 ceph-mon[35473]: overall HEALTH_OK 2024-09-10T23:00:00.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:00 smithi046 ceph-mon[28128]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:00.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:00.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:00.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:00.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:00 smithi046 ceph-mon[28128]: overall HEALTH_OK 2024-09-10T23:00:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:02 smithi046 ceph-mon[28128]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:02.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:02 smithi073 ceph-mon[35473]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:02.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:04.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:04 smithi046 ceph-mon[28128]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:04.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:04 smithi073 ceph-mon[35473]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.040+0000 7fd038a00640 1 -- 172.21.15.73:0/206661676 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd034063590 con 0x7fd01807a370 2024-09-10T23:00:05.043 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 5 on host 'smithi073' 2024-09-10T23:00:05.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.043+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd01807a370 msgr2=0x7fd01807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:05.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.043+0000 7fd039e00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd01807a370 0x7fd01807c830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd024000c00 tx=0x7fd024004d70 comp rx=0 tx=0).stop 2024-09-10T23:00:05.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.043+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 msgr2=0x7fd03419ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:05.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.043+0000 7fd039e00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03419ef40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d6f0 tx=0x7fd02000dbb0 comp rx=0 tx=0).stop 2024-09-10T23:00:05.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.044+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 shutdown_connections 2024-09-10T23:00:05.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.044+0000 7fd039e00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd01807a370 0x7fd01807c830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:05.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.044+0000 7fd039e00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03410a250 0x7fd03419ef40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:05.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.044+0000 7fd039e00640 1 --2- 172.21.15.73:0/206661676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd034108f80 0x7fd03419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:05.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.044+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 >> 172.21.15.73:0/206661676 conn(0x7fd034078140 msgr2=0x7fd03410d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:00:05.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.044+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 shutdown_connections 2024-09-10T23:00:05.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:05.045+0000 7fd039e00640 1 -- 172.21.15.73:0/206661676 wait complete. 2024-09-10T23:00:05.903 DEBUG:teuthology.orchestra.run.smithi073:osd.5> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T23:00:05.908 INFO:tasks.cephadm:Deploying osd.6 on smithi073 with /dev/vg_nvme/lv_2... 2024-09-10T23:00:05.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:00:06.212 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:06.212 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.212 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.212 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.212 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.212 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: from='osd.5 [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:00:06.213 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:06 smithi073 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:00:06.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:06.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:06.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: from='osd.5 [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:00:06.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:06 smithi046 ceph-mon[28128]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:00:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T23:00:07.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:00:07.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-mon[35473]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:00:07.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:07.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-mon[35473]: from='osd.5 [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:07.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:07.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:07 smithi046 ceph-mon[28128]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:00:07.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:07 smithi046 ceph-mon[28128]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:00:07.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:07 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:07.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:07 smithi046 ceph-mon[28128]: from='osd.5 [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:07.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:07 smithi046 ceph-mon[28128]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:07.715 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:00:07.593+0000 7ff110200640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:00:07.716 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:00:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:00:07.612+0000 7ff105800640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:00:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T23:00:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T23:00:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T23:00:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T23:00:08.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:08.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:08.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T23:00:08.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:08.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:08 smithi073 ceph-mon[35473]: from='osd.5 ' entity='osd.5' 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T23:00:08.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:08.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:08 smithi046 ceph-mon[28128]: from='osd.5 ' entity='osd.5' 2024-09-10T23:00:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:09 smithi046 ceph-mon[28128]: osd.5 [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] boot 2024-09-10T23:00:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:09 smithi046 ceph-mon[28128]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:00:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:09.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:09.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:09 smithi073 ceph-mon[35473]: osd.5 [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] boot 2024-09-10T23:00:09.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:09 smithi073 ceph-mon[35473]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:00:09.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:00:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:10 smithi046 ceph-mon[28128]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:10.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:10 smithi046 ceph-mon[28128]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T23:00:10.803 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:10 smithi073 ceph-mon[35473]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:00:10.803 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:10 smithi073 ceph-mon[35473]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T23:00:11.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi073 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi073 to 7456M 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:11.700 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:11.700 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:11.700 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi073 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi073 to 7456M 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:12.620 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:00:12.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-09-10T23:00:13.022 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T23:00:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:12 smithi046 ceph-mon[28128]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:12 smithi073 ceph-mon[35473]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 -- 172.21.15.73:0/310726125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178076f20 msgr2=0x7f6178075580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 --2- 172.21.15.73:0/310726125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178076f20 0x7f6178075580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6168009880 tx=0x7f616802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:00:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 -- 172.21.15.73:0/310726125 shutdown_connections 2024-09-10T23:00:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 --2- 172.21.15.73:0/310726125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6178075ac0 0x7f6178075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 --2- 172.21.15.73:0/310726125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178076f20 0x7f6178075580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 -- 172.21.15.73:0/310726125 >> 172.21.15.73:0/310726125 conn(0x7f61780fdec0 msgr2=0x7f6178100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:00:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 -- 172.21.15.73:0/310726125 shutdown_connections 2024-09-10T23:00:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.678+0000 7f6177e00640 1 -- 172.21.15.73:0/310726125 wait complete. 2024-09-10T23:00:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.679+0000 7f6177e00640 1 Processor -- start 2024-09-10T23:00:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.679+0000 7f6177e00640 1 -- start start 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.679+0000 7f6177e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 0x7f617819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.679+0000 7f6177e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6178076f20 0x7f617819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.679+0000 7f6177e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f617810d4e0 con 0x7f6178076f20 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.679+0000 7f6177e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f617810d360 con 0x7f6178075ac0 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 0x7f617819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 0x7f617819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52286/0 (socket says 172.21.15.73:52286) 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 -- 172.21.15.73:0/2232167195 learned_addr learned my addr 172.21.15.73:0/2232167195 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176000640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6178076f20 0x7f617819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 -- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6178076f20 msgr2=0x7f617819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6178076f20 0x7f617819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 -- 172.21.15.73:0/2232167195 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617819b510 con 0x7f6178075ac0 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.680+0000 7f6176a00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 0x7f617819a360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61680099a0 tx=0x7f6168004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.681+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f616803f070 con 0x7f6178075ac0 2024-09-10T23:00:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.681+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6168004440 con 0x7f6178075ac0 2024-09-10T23:00:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.681+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6168035030 con 0x7f6178075ac0 2024-09-10T23:00:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.681+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617819b7a0 con 0x7f6178075ac0 2024-09-10T23:00:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.681+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f617819bd50 con 0x7f6178075ac0 2024-09-10T23:00:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.682+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617810dc30 con 0x7f6178075ac0 2024-09-10T23:00:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.683+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f6168003c10 con 0x7f6178075ac0 2024-09-10T23:00:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.684+0000 7f616f400640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f615c07a370 0x7f615c07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:00:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.684+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f61680bd960 con 0x7f6178075ac0 2024-09-10T23:00:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.684+0000 7f6176000640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f615c07a370 0x7f615c07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:00:13.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.685+0000 7f6176000640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f615c07a370 0x7f615c07c830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6164005fd0 tx=0x7f616400b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:00:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.689+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6168089ad0 con 0x7f6178075ac0 2024-09-10T23:00:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:13.885+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6178063590 con 0x7f615c07a370 2024-09-10T23:00:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:14 smithi073 ceph-mon[35473]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:00:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:00:14.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:14 smithi046 ceph-mon[28128]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:00:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:00:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:15.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:15 smithi046 ceph-mon[28128]: from='client.24249 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:00:15.908 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:15 smithi073 ceph-mon[35473]: from='client.24249 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:00:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:16 smithi046 ceph-mon[28128]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:16 smithi073 ceph-mon[35473]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:17.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:17 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/3749048195' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5725994-7afe-4abf-b961-99b13c47a55b"} : dispatch 2024-09-10T23:00:17.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:17 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5725994-7afe-4abf-b961-99b13c47a55b"} : dispatch 2024-09-10T23:00:17.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:17 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5725994-7afe-4abf-b961-99b13c47a55b"}]': finished 2024-09-10T23:00:17.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:17 smithi073 ceph-mon[35473]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:00:17.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:17 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/3749048195' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5725994-7afe-4abf-b961-99b13c47a55b"} : dispatch 2024-09-10T23:00:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:17 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5725994-7afe-4abf-b961-99b13c47a55b"} : dispatch 2024-09-10T23:00:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:17 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5725994-7afe-4abf-b961-99b13c47a55b"}]': finished 2024-09-10T23:00:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:17 smithi046 ceph-mon[28128]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:00:18.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:19.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:18 smithi046 ceph-mon[28128]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:19.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:18 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/865583066' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:00:19.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:18 smithi073 ceph-mon[35473]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:19.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:18 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/865583066' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:00:20.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:20 smithi046 ceph-mon[28128]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:20.909 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:20 smithi073 ceph-mon[35473]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:22.909 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:22 smithi073 ceph-mon[35473]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:23.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:22 smithi046 ceph-mon[28128]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:24.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:24 smithi073 ceph-mon[35473]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:24 smithi046 ceph-mon[28128]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:26.010 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:25 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:00:26.010 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:25 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:26.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:25 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:00:26.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:25 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:27.063 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:26 smithi073 ceph-mon[35473]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:27.063 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:26 smithi073 ceph-mon[35473]: Deploying daemon osd.6 on smithi073 2024-09-10T23:00:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:26 smithi046 ceph-mon[28128]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:27.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:26 smithi046 ceph-mon[28128]: Deploying daemon osd.6 on smithi073 2024-09-10T23:00:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:28 smithi046 ceph-mon[28128]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:29.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:28 smithi073 ceph-mon[35473]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:31.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:30 smithi046 ceph-mon[28128]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:30 smithi073 ceph-mon[35473]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:31.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:33.017 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:32 smithi073 ceph-mon[35473]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:32 smithi046 ceph-mon[28128]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:34.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:34.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:34.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:34 smithi073 ceph-mon[35473]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:34 smithi046 ceph-mon[28128]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:36 smithi073 ceph-mon[35473]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:36 smithi046 ceph-mon[28128]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:38.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.540+0000 7f616f400640 1 -- 172.21.15.73:0/2232167195 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6178063590 con 0x7f615c07a370 2024-09-10T23:00:38.542 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 6 on host 'smithi073' 2024-09-10T23:00:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f615c07a370 msgr2=0x7f615c07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f615c07a370 0x7f615c07c830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6164005fd0 tx=0x7f616400b390 comp rx=0 tx=0).stop 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 msgr2=0x7f617819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 0x7f617819a360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61680099a0 tx=0x7f6168004040 comp rx=0 tx=0).stop 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 shutdown_connections 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f615c07a370 0x7f615c07c830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6178076f20 0x7f617819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 --2- 172.21.15.73:0/2232167195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6178075ac0 0x7f617819a360 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.542+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 >> 172.21.15.73:0/2232167195 conn(0x7f61780fdec0 msgr2=0x7f61781087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.543+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 shutdown_connections 2024-09-10T23:00:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:38.543+0000 7f6177e00640 1 -- 172.21.15.73:0/2232167195 wait complete. 2024-09-10T23:00:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:38 smithi073 ceph-mon[35473]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:38.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:39.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:38 smithi046 ceph-mon[28128]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:39.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:39.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:39.323 DEBUG:teuthology.orchestra.run.smithi073:osd.6> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T23:00:39.327 INFO:tasks.cephadm:Deploying osd.7 on smithi073 with /dev/vg_nvme/lv_1... 2024-09-10T23:00:39.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:00:39.760 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T23:00:40.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:39 smithi046 ceph-mon[28128]: from='osd.6 [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:00:40.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:39 smithi046 ceph-mon[28128]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:00:40.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:40.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:39 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:39 smithi073 ceph-mon[35473]: from='osd.6 [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:00:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:39 smithi073 ceph-mon[35473]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:00:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:40.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:39 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:41.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:40 smithi046 ceph-mon[28128]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:41.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:40 smithi046 ceph-mon[28128]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:00:41.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:40 smithi046 ceph-mon[28128]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T23:00:41.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:40 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:41.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:40 smithi046 ceph-mon[28128]: from='osd.6 [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:41.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:40 smithi046 ceph-mon[28128]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-mon[35473]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-mon[35473]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:00:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-mon[35473]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T23:00:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-mon[35473]: from='osd.6 [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:41.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-mon[35473]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:00:41.081 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:00:40.713+0000 7fe309a00640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:00:41.081 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:00:40 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:00:40.733+0000 7fe304a00640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: osd.6 [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] boot 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T23:00:41.763 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:42.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T23:00:42.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T23:00:42.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:42.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:42.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: osd.6 [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] boot 2024-09-10T23:00:42.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T23:00:42.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:00:42.926 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:42 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T23:00:42.926 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:42 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T23:00:42.926 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:42 smithi073 ceph-mon[35473]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:42.926 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:42 smithi073 ceph-mon[35473]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T23:00:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:42 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T23:00:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:42 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T23:00:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:42 smithi046 ceph-mon[28128]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:00:43.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:42 smithi046 ceph-mon[28128]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T23:00:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:00:43.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_1 2024-09-10T23:00:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T23:00:44.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:44 smithi073 ceph-mon[35473]: pgmap v189: 1 pgs: 1 unknown; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:00:44.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:44 smithi073 ceph-mon[35473]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T23:00:45.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:44 smithi046 ceph-mon[28128]: pgmap v189: 1 pgs: 1 unknown; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:00:45.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:44 smithi046 ceph-mon[28128]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T23:00:45.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 -- 172.21.15.73:0/2364232202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 msgr2=0x7fc208104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:45.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 --2- 172.21.15.73:0/2364232202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc208104dc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009880 tx=0x7fc1f802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:00:45.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 -- 172.21.15.73:0/2364232202 shutdown_connections 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 --2- 172.21.15.73:0/2364232202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc208105b20 0x7fc208105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 --2- 172.21.15.73:0/2364232202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc208104dc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 -- 172.21.15.73:0/2364232202 >> 172.21.15.73:0/2364232202 conn(0x7fc2081002d0 msgr2=0x7fc2081026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 -- 172.21.15.73:0/2364232202 shutdown_connections 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.396+0000 7fc20dc00640 1 -- 172.21.15.73:0/2364232202 wait complete. 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.397+0000 7fc20dc00640 1 Processor -- start 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.397+0000 7fc20dc00640 1 -- start start 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.397+0000 7fc20dc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc20819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:00:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc20dc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc208105b20 0x7fc20819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:00:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc20dc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc20810d690 con 0x7fc208105b20 2024-09-10T23:00:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc20dc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc20810d510 con 0x7fc2081049c0 2024-09-10T23:00:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc20819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:00:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc20819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49710/0 (socket says 172.21.15.73:49710) 2024-09-10T23:00:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206a00640 1 -- 172.21.15.73:0/863294980 learned_addr learned my addr 172.21.15.73:0/863294980 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T23:00:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206000640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc208105b20 0x7fc20819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206a00640 1 -- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc208105b20 msgr2=0x7fc20819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206a00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc208105b20 0x7fc20819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.398+0000 7fc206a00640 1 -- 172.21.15.73:0/863294980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20819b6d0 con 0x7fc2081049c0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.399+0000 7fc206a00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc20819a4b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009230 tx=0x7fc1f8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.399+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1f803f070 con 0x7fc2081049c0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.399+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1f80052d0 con 0x7fc2081049c0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.399+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20819b960 con 0x7fc2081049c0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.399+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1f8035030 con 0x7fc2081049c0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.399+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20819bf10 con 0x7fc2081049c0 2024-09-10T23:00:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.400+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20810dde0 con 0x7fc2081049c0 2024-09-10T23:00:45.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.402+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fc1f80035f0 con 0x7fc2081049c0 2024-09-10T23:00:45.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.402+0000 7fc1ff400640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1ec07a320 0x7fc1ec07c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:00:45.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.403+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5070+0+0 (secure 0 0 0) 0x7fc1f80bdea0 con 0x7fc2081049c0 2024-09-10T23:00:45.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.403+0000 7fc206000640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1ec07a320 0x7fc1ec07c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:00:45.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.404+0000 7fc206000640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1ec07a320 0x7fc1ec07c7e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40058c0 tx=0x7fc1f400a2d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:00:45.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.409+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc1f8089e80 con 0x7fc2081049c0 2024-09-10T23:00:45.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:00:45.618+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc208063590 con 0x7fc1ec07a320 2024-09-10T23:00:45.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:45 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:00:45.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:45 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:00:45.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:45 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:46.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:45 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:00:46.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:45 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:00:46.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:45 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='client.24267 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:46.980 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:46.981 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:46.981 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:46.981 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:46.981 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:46.981 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='client.24267 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:00:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:47.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:47.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:47.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:47.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:47 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi073 2024-09-10T23:00:47.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:47 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi073 to 4971M 2024-09-10T23:00:47.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:47.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:47.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:47.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:48.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:47 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi073 2024-09-10T23:00:48.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:47 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi073 to 4971M 2024-09-10T23:00:48.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:00:48.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:48.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:00:48.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:00:49.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:48 smithi046 ceph-mon[28128]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:00:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:48 smithi073 ceph-mon[35473]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:00:49.990 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:49 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/585117360' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44eb7536-2797-402a-8041-e0b97cac2cd0"} : dispatch 2024-09-10T23:00:49.990 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:49 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44eb7536-2797-402a-8041-e0b97cac2cd0"} : dispatch 2024-09-10T23:00:49.990 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:49 smithi073 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44eb7536-2797-402a-8041-e0b97cac2cd0"}]': finished 2024-09-10T23:00:49.991 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:49 smithi073 ceph-mon[35473]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T23:00:49.991 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:00:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:49 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/585117360' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44eb7536-2797-402a-8041-e0b97cac2cd0"} : dispatch 2024-09-10T23:00:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:49 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44eb7536-2797-402a-8041-e0b97cac2cd0"} : dispatch 2024-09-10T23:00:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:49 smithi046 ceph-mon[28128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44eb7536-2797-402a-8041-e0b97cac2cd0"}]': finished 2024-09-10T23:00:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:49 smithi046 ceph-mon[28128]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T23:00:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:00:51.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:50 smithi046 ceph-mon[28128]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T23:00:51.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:50 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2278320834' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:00:51.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:50 smithi073 ceph-mon[35473]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T23:00:51.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:50 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/2278320834' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:00:53.053 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:52 smithi073 ceph-mon[35473]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:00:53.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:52 smithi046 ceph-mon[28128]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:00:55.009 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:54 smithi073 ceph-mon[35473]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:00:55.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:54 smithi046 ceph-mon[28128]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:00:56.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:56 smithi073 ceph-mon[35473]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:00:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:56 smithi046 ceph-mon[28128]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:00:59.011 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:58 smithi073 ceph-mon[35473]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:00:59.011 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:58 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:00:59.011 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:58 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:58 smithi046 ceph-mon[28128]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:00:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:58 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:00:59.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:58 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:00:59.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:00:59 smithi073 ceph-mon[35473]: Deploying daemon osd.7 on smithi073 2024-09-10T23:01:00.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:00:59 smithi046 ceph-mon[28128]: Deploying daemon osd.7 on smithi073 2024-09-10T23:01:00.914 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:00 smithi073 ceph-mon[35473]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:01.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:00 smithi046 ceph-mon[28128]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:01.860 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:02.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:03.011 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:02 smithi073 ceph-mon[35473]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:02 smithi046 ceph-mon[28128]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:05.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:04 smithi046 ceph-mon[28128]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:05.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:04 smithi073 ceph-mon[35473]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:06.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:06 smithi073 ceph-mon[35473]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:06.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:01:06.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:06.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:07.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:06 smithi046 ceph-mon[28128]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:07.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:01:07.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:07.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:09.001 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:08 smithi073 ceph-mon[35473]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:09.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:08 smithi046 ceph-mon[28128]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:10.957 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 7 on host 'smithi073' 2024-09-10T23:01:10.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.956+0000 7fc1ff400640 1 -- 172.21.15.73:0/863294980 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc208063590 con 0x7fc1ec07a320 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1ec07a320 msgr2=0x7fc1ec07c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1ec07a320 0x7fc1ec07c7e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40058c0 tx=0x7fc1f400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 msgr2=0x7fc20819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc20819a4b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009230 tx=0x7fc1f8004270 comp rx=0 tx=0).stop 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 shutdown_connections 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1ec07a320 0x7fc1ec07c7e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc208105b20 0x7fc20819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 --2- 172.21.15.73:0/863294980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2081049c0 0x7fc20819a4b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:10.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 >> 172.21.15.73:0/863294980 conn(0x7fc2081002d0 msgr2=0x7fc208109030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:10.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 shutdown_connections 2024-09-10T23:01:10.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:10.959+0000 7fc20dc00640 1 -- 172.21.15.73:0/863294980 wait complete. 2024-09-10T23:01:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:10 smithi046 ceph-mon[28128]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:11.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:10 smithi073 ceph-mon[35473]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:11.858 DEBUG:teuthology.orchestra.run.smithi073:osd.7> sudo journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T23:01:11.862 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-10T23:01:11.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:01:12.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:12.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:12.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:11 smithi073 ceph-mon[35473]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:12.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:11 smithi073 ceph-mon[35473]: from='osd.7 [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:01:12.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:11 smithi073 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:01:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:12.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:12.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:12.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:11 smithi046 ceph-mon[28128]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:12.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:11 smithi046 ceph-mon[28128]: from='osd.7 [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:01:12.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:11 smithi046 ceph-mon[28128]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:01:12.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 -- 172.21.15.46:0/1463884177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec103750 msgr2=0x7f52ec103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 --2- 172.21.15.46:0/1463884177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec103750 0x7f52ec103bd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009880 tx=0x7f52d402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 -- 172.21.15.46:0/1463884177 shutdown_connections 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 --2- 172.21.15.46:0/1463884177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec103750 0x7f52ec103bd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 --2- 172.21.15.46:0/1463884177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec1025f0 0x7f52ec1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 -- 172.21.15.46:0/1463884177 >> 172.21.15.46:0/1463884177 conn(0x7f52ec0fdec0 msgr2=0x7f52ec100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 -- 172.21.15.46:0/1463884177 shutdown_connections 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.787+0000 7f52f2600640 1 -- 172.21.15.46:0/1463884177 wait complete. 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.788+0000 7f52f2600640 1 Processor -- start 2024-09-10T23:01:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.788+0000 7f52f2600640 1 -- start start 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.788+0000 7f52f2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 0x7f52ec19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.788+0000 7f52f2600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec103750 0x7f52ec19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.788+0000 7f52f2600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec10b2e0 con 0x7f52ec1025f0 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.788+0000 7f52f2600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec10b160 con 0x7f52ec103750 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 0x7f52ec19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 0x7f52ec19a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56688/0 (socket says 172.21.15.46:56688) 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 -- 172.21.15.46:0/4142622226 learned_addr learned my addr 172.21.15.46:0/4142622226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52e3e00640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec103750 0x7f52ec19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 -- 172.21.15.46:0/4142622226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec103750 msgr2=0x7f52ec19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec103750 0x7f52ec19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 -- 172.21.15.46:0/4142622226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec19b4e0 con 0x7f52ec1025f0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52e3e00640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec103750 0x7f52ec19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.789+0000 7f52f1200640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 0x7f52ec19a2c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e970 tx=0x7f52dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.790+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52dc00cac0 con 0x7f52ec1025f0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.790+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52dc0054b0 con 0x7f52ec1025f0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.790+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec19b7d0 con 0x7f52ec1025f0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.790+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52dc004c40 con 0x7f52ec1025f0 2024-09-10T23:01:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.790+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec19bde0 con 0x7f52ec1025f0 2024-09-10T23:01:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.791+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec10ba30 con 0x7f52ec1025f0 2024-09-10T23:01:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.792+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f52dc00cc60 con 0x7f52ec1025f0 2024-09-10T23:01:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.793+0000 7f52ea000640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f52d007a320 0x7f52d007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.793+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5206+0+0 (secure 0 0 0) 0x7f52dc09d4a0 con 0x7f52ec1025f0 2024-09-10T23:01:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.793+0000 7f52e3e00640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f52d007a320 0x7f52d007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.794+0000 7f52e3e00640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f52d007a320 0x7f52d007c7e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000c00 tx=0x7f52d4004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:12.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.797+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f52dc064f70 con 0x7f52ec1025f0 2024-09-10T23:01:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.997+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f52ec1a0750 con 0x7f52ec1025f0 2024-09-10T23:01:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.997+0000 7f52ea000640 1 -- 172.21.15.46:0/4142622226 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v49) ==== 74+0+130 (secure 0 0 0) 0x7f52dc069350 con 0x7f52ec1025f0 2024-09-10T23:01:12.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f52d007a320 msgr2=0x7f52d007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f52d007a320 0x7f52d007c7e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000c00 tx=0x7f52d4004d70 comp rx=0 tx=0).stop 2024-09-10T23:01:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 msgr2=0x7f52ec19a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 0x7f52ec19a2c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e970 tx=0x7f52dc00ed70 comp rx=0 tx=0).stop 2024-09-10T23:01:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 shutdown_connections 2024-09-10T23:01:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f52d007a320 0x7f52d007c7e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec103750 0x7f52ec19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 --2- 172.21.15.46:0/4142622226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec1025f0 0x7f52ec19a2c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:12.999+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 >> 172.21.15.46:0/4142622226 conn(0x7f52ec0fdec0 msgr2=0x7f52ec0754d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:13.000+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 shutdown_connections 2024-09-10T23:01:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:13.000+0000 7f52f2600640 1 -- 172.21.15.46:0/4142622226 wait complete. 2024-09-10T23:01:13.132 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:01:13.132 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T23:01:13.132 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:13.132 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: from='osd.7 [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:01:13.132 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:01:13.133 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:13.133 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:13.133 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:01:12.976+0000 7f79dcc00640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:01:13.133 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:01:12 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:01:12.984+0000 7f79d7c00640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:01:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:01:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T23:01:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: from='osd.7 [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:01:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-10T23:01:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:13.839 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":49,"num_osds":8,"num_up_osds":7,"osd_up_since":1726009241,"num_in_osds":8,"osd_in_since":1726009249,"num_remapped_pgs":0} 2024-09-10T23:01:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:13 smithi046 ceph-mon[28128]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:13 smithi046 ceph-mon[28128]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T23:01:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:13 smithi046 ceph-mon[28128]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T23:01:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:14.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:13 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/4142622226' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:01:14.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:13 smithi073 ceph-mon[35473]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:01:14.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:13 smithi073 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T23:01:14.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:13 smithi073 ceph-mon[35473]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T23:01:14.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:14.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:14.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:13 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/4142622226' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:01:14.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:01:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:15.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:14 smithi046 ceph-mon[28128]: purged_snaps scrub starts 2024-09-10T23:01:15.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:14 smithi046 ceph-mon[28128]: purged_snaps scrub ok 2024-09-10T23:01:15.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:14 smithi046 ceph-mon[28128]: osd.7 [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] boot 2024-09-10T23:01:15.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:14 smithi046 ceph-mon[28128]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T23:01:15.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:15.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:14 smithi046 ceph-mon[28128]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T23:01:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:14 smithi073 ceph-mon[35473]: purged_snaps scrub starts 2024-09-10T23:01:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:14 smithi073 ceph-mon[35473]: purged_snaps scrub ok 2024-09-10T23:01:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:14 smithi073 ceph-mon[35473]: osd.7 [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] boot 2024-09-10T23:01:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:14 smithi073 ceph-mon[35473]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T23:01:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:01:15.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:14 smithi073 ceph-mon[35473]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T23:01:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 -- 172.21.15.46:0/3621584009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 msgr2=0x7fc8f4077e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3621584009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f4077e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009880 tx=0x7fc8e402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 -- 172.21.15.46:0/3621584009 shutdown_connections 2024-09-10T23:01:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3621584009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 0x7fc8f4078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3621584009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f4077e10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 -- 172.21.15.46:0/3621584009 >> 172.21.15.46:0/3621584009 conn(0x7fc8f41002d0 msgr2=0x7fc8f41026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 -- 172.21.15.46:0/3621584009 shutdown_connections 2024-09-10T23:01:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.743+0000 7fc8f9000640 1 -- 172.21.15.46:0/3621584009 wait complete. 2024-09-10T23:01:15.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.744+0000 7fc8f9000640 1 Processor -- start 2024-09-10T23:01:15.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.744+0000 7fc8f9000640 1 -- start start 2024-09-10T23:01:15.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:15.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 0x7fc8f419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f9000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4111ab0 con 0x7fc8f4077a10 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f9000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4111930 con 0x7fc8f4078b70 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f419e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59260/0 (socket says 172.21.15.46:59260) 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1e00640 1 -- 172.21.15.46:0/3575917991 learned_addr learned my addr 172.21.15.46:0/3575917991 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1400640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 0x7fc8f419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1400640 1 -- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 msgr2=0x7fc8f419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1400640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1400640 1 -- 172.21.15.46:0/3575917991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f419fb00 con 0x7fc8f4078b70 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.745+0000 7fc8f1e00640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:01:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.746+0000 7fc8f1400640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 0x7fc8f419ef30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000e970 tx=0x7fc8e000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.746+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8e000cac0 con 0x7fc8f4078b70 2024-09-10T23:01:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.746+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f419fdf0 con 0x7fc8f4078b70 2024-09-10T23:01:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.746+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8e000cc60 con 0x7fc8f4078b70 2024-09-10T23:01:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.746+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8e0005610 con 0x7fc8f4078b70 2024-09-10T23:01:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.746+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41a0400 con 0x7fc8f4078b70 2024-09-10T23:01:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.747+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f4077e10 con 0x7fc8f4078b70 2024-09-10T23:01:15.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.750+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fc8e0004870 con 0x7fc8f4078b70 2024-09-10T23:01:15.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.751+0000 7fc8eaa00640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8d807a320 0x7fc8d807c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:15.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.751+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5502+0+0 (secure 0 0 0) 0x7fc8e009d3e0 con 0x7fc8f4078b70 2024-09-10T23:01:15.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.751+0000 7fc8f1e00640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8d807a320 0x7fc8d807c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:15.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.752+0000 7fc8f1e00640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8d807a320 0x7fc8d807c7e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009230 tx=0x7fc8e40058d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:15.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.755+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8e0064d90 con 0x7fc8f4078b70 2024-09-10T23:01:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.952+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc8f402e5c0 con 0x7fc8f4078b70 2024-09-10T23:01:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.953+0000 7fc8eaa00640 1 -- 172.21.15.46:0/3575917991 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v51) ==== 74+0+130 (secure 0 0 0) 0x7fc8e0069170 con 0x7fc8f4078b70 2024-09-10T23:01:15.954 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8d807a320 msgr2=0x7fc8d807c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8d807a320 0x7fc8d807c7e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009230 tx=0x7fc8e40058d0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 msgr2=0x7fc8f419ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 0x7fc8f419ef30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000e970 tx=0x7fc8e000ee30 comp rx=0 tx=0).stop 2024-09-10T23:01:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 shutdown_connections 2024-09-10T23:01:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc8d807a320 0x7fc8d807c7e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f4078b70 0x7fc8f419ef30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.955+0000 7fc8f9000640 1 --2- 172.21.15.46:0/3575917991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8f4077a10 0x7fc8f419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.956+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 >> 172.21.15.46:0/3575917991 conn(0x7fc8f41002d0 msgr2=0x7fc8f410ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.956+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 shutdown_connections 2024-09-10T23:01:15.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:15.956+0000 7fc8f9000640 1 -- 172.21.15.46:0/3575917991 wait complete. 2024-09-10T23:01:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:15 smithi046 ceph-mon[28128]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:16.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:15 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3575917991' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:01:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:15 smithi073 ceph-mon[35473]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:15 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3575917991' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:01:16.808 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1726009273,"num_in_osds":8,"osd_in_since":1726009249,"num_remapped_pgs":0} 2024-09-10T23:01:16.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: Detected new or changed devices on smithi073 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi073 to 3728M 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:01:17.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: Detected new or changed devices on smithi073 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:01:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi073 to 3728M 2024-09-10T23:01:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:01:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:01:17.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 -- 172.21.15.46:0/1048824501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 msgr2=0x7f88b410ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 --2- 172.21.15.46:0/1048824501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b410ef10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009880 tx=0x7f88a002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 -- 172.21.15.46:0/1048824501 shutdown_connections 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 --2- 172.21.15.46:0/1048824501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b410ef10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 --2- 172.21.15.46:0/1048824501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b4109240 0x7f88b4109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 -- 172.21.15.46:0/1048824501 >> 172.21.15.46:0/1048824501 conn(0x7f88b4078780 msgr2=0x7f88b407aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.707+0000 7f88bc200640 1 -- 172.21.15.46:0/1048824501 shutdown_connections 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.708+0000 7f88bc200640 1 -- 172.21.15.46:0/1048824501 wait complete. 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.708+0000 7f88bc200640 1 Processor -- start 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.708+0000 7f88bc200640 1 -- start start 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88bc200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b4109240 0x7f88b419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88bc200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88bc200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88b41161e0 con 0x7f88b410eaf0 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88bc200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4116060 con 0x7f88b4109240 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b8e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b8e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b419f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59280/0 (socket says 172.21.15.46:59280) 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b8e00640 1 -- 172.21.15.46:0/2584930482 learned_addr learned my addr 172.21.15.46:0/2584930482 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b9800640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b4109240 0x7f88b419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b8e00640 1 -- 172.21.15.46:0/2584930482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b4109240 msgr2=0x7f88b419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b8e00640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b4109240 0x7f88b419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.709+0000 7f88b8e00640 1 -- 172.21.15.46:0/2584930482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b41a47a0 con 0x7f88b410eaf0 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.710+0000 7f88b8e00640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b419f400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f88a0006010 tx=0x7f88a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.710+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88a003f070 con 0x7f88b410eaf0 2024-09-10T23:01:17.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.710+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88a0004a50 con 0x7f88b410eaf0 2024-09-10T23:01:17.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.710+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88a0035030 con 0x7f88b410eaf0 2024-09-10T23:01:17.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.710+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b41a4a30 con 0x7f88b410eaf0 2024-09-10T23:01:17.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.710+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b41a4fe0 con 0x7f88b410eaf0 2024-09-10T23:01:17.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.711+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b419fb80 con 0x7f88b410eaf0 2024-09-10T23:01:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.712+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f88a0003b80 con 0x7f88b410eaf0 2024-09-10T23:01:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.714+0000 7f88b2000640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f889c07a370 0x7f889c07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.714+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f88a00bdc50 con 0x7f88b410eaf0 2024-09-10T23:01:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.714+0000 7f88b9800640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f889c07a370 0x7f889c07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.715+0000 7f88b9800640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f889c07a370 0x7f889c07c830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009990 tx=0x7f88a8009110 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.719+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88b419fb80 con 0x7f88b410eaf0 2024-09-10T23:01:17.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.918+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88b41112a0 con 0x7f88b410eaf0 2024-09-10T23:01:17.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.919+0000 7f88b2000640 1 -- 172.21.15.46:0/2584930482 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+13868 (secure 0 0 0) 0x7f88a0085680 con 0x7f88b410eaf0 2024-09-10T23:01:17.921 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:17.922 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","created":"2024-09-10T22:53:11.794585+0000","modified":"2024-09-10T23:01:15.971073+0000","last_up_change":"2024-09-10T23:01:13.959042+0000","last_in_change":"2024-09-10T23:00:49.264739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:58:33.387526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5460ef41-5ff6-4583-8410-9f83bcd495f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6803","nonce":2885579696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6805","nonce":2885579696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6809","nonce":2885579696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6807","nonce":2885579696}]},"public_addr":"172.21.15.46:6803/2885579696","cluster_addr":"172.21.15.46:6805/2885579696","heartbeat_back_addr":"172.21.15.46:6809/2885579696","heartbeat_front_addr":"172.21.15.46:6807/2885579696","state":["exists","up"]},{"osd":1,"uuid":"294d3916-f4c1-42a6-bfd4-7430ca8b8c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6811","nonce":3611441892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6813","nonce":3611441892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6817","nonce":3611441892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6815","nonce":3611441892}]},"public_addr":"172.21.15.46:6811/3611441892","cluster_addr":"172.21.15.46:6813/3611441892","heartbeat_back_addr":"172.21.15.46:6817/3611441892","heartbeat_front_addr":"172.21.15.46:6815/3611441892","state":["exists","up"]},{"osd":2,"uuid":"7cfa1ba4-f5c8-4efc-b923-73a99fad468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6819","nonce":3774780724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6821","nonce":3774780724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6825","nonce":3774780724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6823","nonce":3774780724}]},"public_addr":"172.21.15.46:6819/3774780724","cluster_addr":"172.21.15.46:6821/3774780724","heartbeat_back_addr":"172.21.15.46:6825/3774780724","heartbeat_front_addr":"172.21.15.46:6823/3774780724","state":["exists","up"]},{"osd":3,"uuid":"8575c985-20a6-4edb-8186-e502888ef174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6827","nonce":1627285252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6829","nonce":1627285252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6833","nonce":1627285252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6831","nonce":1627285252}]},"public_addr":"172.21.15.46:6827/1627285252","cluster_addr":"172.21.15.46:6829/1627285252","heartbeat_back_addr":"172.21.15.46:6833/1627285252","heartbeat_front_addr":"172.21.15.46:6831/1627285252","state":["exists","up"]},{"osd":4,"uuid":"5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6801","nonce":4123471774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6803","nonce":4123471774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6807","nonce":4123471774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6805","nonce":4123471774}]},"public_addr":"172.21.15.73:6801/4123471774","cluster_addr":"172.21.15.73:6803/4123471774","heartbeat_back_addr":"172.21.15.73:6807/4123471774","heartbeat_front_addr":"172.21.15.73:6805/4123471774","state":["exists","up"]},{"osd":5,"uuid":"84431538-dde7-43ca-94c2-ec8a3ce72421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6809","nonce":3681064684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6811","nonce":3681064684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6815","nonce":3681064684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6813","nonce":3681064684}]},"public_addr":"172.21.15.73:6809/3681064684","cluster_addr":"172.21.15.73:6811/3681064684","heartbeat_back_addr":"172.21.15.73:6815/3681064684","heartbeat_front_addr":"172.21.15.73:6813/3681064684","state":["exists","up"]},{"osd":6,"uuid":"c5725994-7afe-4abf-b961-99b13c47a55b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6817","nonce":2364854184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6819","nonce":2364854184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6823","nonce":2364854184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6821","nonce":2364854184}]},"public_addr":"172.21.15.73:6817/2364854184","cluster_addr":"172.21.15.73:6819/2364854184","heartbeat_back_addr":"172.21.15.73:6823/2364854184","heartbeat_front_addr":"172.21.15.73:6821/2364854184","state":["exists","up"]},{"osd":7,"uuid":"44eb7536-2797-402a-8041-e0b97cac2cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6825","nonce":1690062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6827","nonce":1690062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6831","nonce":1690062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6829","nonce":1690062257}]},"public_addr":"172.21.15.73:6825/1690062257","cluster_addr":"172.21.15.73:6827/1690062257","heartbeat_back_addr":"172.21.15.73:6831/1690062257","heartbeat_front_addr":"172.21.15.73:6829/1690062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:23.184934+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:57.854549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:58:30.670491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:02.736727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:33.037689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:06.105862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:39.985408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:01:12.056861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3052523989":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6801/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/2163720030":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/220137103":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/3240682838":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/263522480":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/1989006756":"2024-09-11T22:53:39.482819+0000","172.21.15.46:6800/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6800/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6800/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/1231598076":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/1514329312":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/2623235150":"2024-09-11T22:55:30.890832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:01:17.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f889c07a370 msgr2=0x7f889c07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f889c07a370 0x7f889c07c830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009990 tx=0x7f88a8009110 comp rx=0 tx=0).stop 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 msgr2=0x7f88b419f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b419f400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f88a0006010 tx=0x7f88a00045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 shutdown_connections 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f889c07a370 0x7f889c07c830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b410eaf0 0x7f88b419f400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 --2- 172.21.15.46:0/2584930482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b4109240 0x7f88b419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 >> 172.21.15.46:0/2584930482 conn(0x7f88b4078780 msgr2=0x7f88b407ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 shutdown_connections 2024-09-10T23:01:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:17.922+0000 7f88bc200640 1 -- 172.21.15.46:0/2584930482 wait complete. 2024-09-10T23:01:18.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:17 smithi046 ceph-mon[28128]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:18.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:01:18.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:01:18.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:01:18.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:18.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:17 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2584930482' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:01:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:17 smithi073 ceph-mon[35473]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:01:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:01:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:01:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:01:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:17 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2584930482' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:01:18.724 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:58:33.387526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:01:18.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T23:01:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 -- 172.21.15.46:0/3499330302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 msgr2=0x7f21c0105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 --2- 172.21.15.46:0/3499330302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c0105110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009880 tx=0x7f21b002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 -- 172.21.15.46:0/3499330302 shutdown_connections 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 --2- 172.21.15.46:0/3499330302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c010a740 0x7f21c010ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 --2- 172.21.15.46:0/3499330302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c0105110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 -- 172.21.15.46:0/3499330302 >> 172.21.15.46:0/3499330302 conn(0x7f21c0100780 msgr2=0x7f21c0102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 -- 172.21.15.46:0/3499330302 shutdown_connections 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.594+0000 7f21c5c00640 1 -- 172.21.15.46:0/3499330302 wait complete. 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.595+0000 7f21c5c00640 1 Processor -- start 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.595+0000 7f21c5c00640 1 -- start start 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.595+0000 7f21c5c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.595+0000 7f21c5c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c010a740 0x7f21c019aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.595+0000 7f21c5c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111d60 con 0x7f21c0104d30 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.595+0000 7f21c5c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111be0 con 0x7f21c010a740 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59296/0 (socket says 172.21.15.46:59296) 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 -- 172.21.15.46:0/91776923 learned_addr learned my addr 172.21.15.46:0/91776923 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21be000640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c010a740 0x7f21c019aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 -- 172.21.15.46:0/91776923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c010a740 msgr2=0x7f21c019aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c010a740 0x7f21c019aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 -- 172.21.15.46:0/91776923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c01a0280 con 0x7f21c0104d30 2024-09-10T23:01:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.596+0000 7f21bea00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c019a9a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21b0006010 tx=0x7f21b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.597+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21b003f070 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.597+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c01a0510 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.597+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21b00049d0 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.597+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21b0035030 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.597+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c01a0a40 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.598+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c019b660 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.599+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f21b00035f0 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.600+0000 7f21b7400640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f21a407a320 0x7f21a407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.600+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f21b00bdd20 con 0x7f21c0104d30 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.601+0000 7f21be000640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f21a407a320 0x7f21a407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.601+0000 7f21be000640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f21a407a320 0x7f21a407c7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005fd0 tx=0x7f21ac005850 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.605+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f21c019b660 con 0x7f21c0104d30 2024-09-10T23:01:19.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.804+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f21c010cee0 con 0x7f21c0104d30 2024-09-10T23:01:19.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.805+0000 7f21b7400640 1 -- 172.21.15.46:0/91776923 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) ==== 93+0+10 (secure 0 0 0) 0x7f21b00856d0 con 0x7f21c0104d30 2024-09-10T23:01:19.807 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-10T23:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f21a407a320 msgr2=0x7f21a407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f21a407a320 0x7f21a407c7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005fd0 tx=0x7f21ac005850 comp rx=0 tx=0).stop 2024-09-10T23:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 msgr2=0x7f21c019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c019a9a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21b0006010 tx=0x7f21b00045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 shutdown_connections 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f21a407a320 0x7f21a407c7e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c010a740 0x7f21c019aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 --2- 172.21.15.46:0/91776923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21c0104d30 0x7f21c019a9a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 >> 172.21.15.46:0/91776923 conn(0x7f21c0100780 msgr2=0x7f21c0101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 shutdown_connections 2024-09-10T23:01:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:19.807+0000 7f21c5c00640 1 -- 172.21.15.46:0/91776923 wait complete. 2024-09-10T23:01:20.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:19 smithi046 ceph-mon[28128]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:20.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:19 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/91776923' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:01:20.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:19 smithi073 ceph-mon[35473]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:20.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:19 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/91776923' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:01:20.630 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T23:01:20.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T23:01:21.012 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 -- 172.21.15.46:0/2592692847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec102790 msgr2=0x7f5eec102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 --2- 172.21.15.46:0/2592692847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec102790 0x7f5eec102b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009880 tx=0x7f5edc02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 -- 172.21.15.46:0/2592692847 shutdown_connections 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 --2- 172.21.15.46:0/2592692847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eec1038f0 0x7f5eec103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 --2- 172.21.15.46:0/2592692847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec102790 0x7f5eec102b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 -- 172.21.15.46:0/2592692847 >> 172.21.15.46:0/2592692847 conn(0x7f5eec0fe060 msgr2=0x7f5eec1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 -- 172.21.15.46:0/2592692847 shutdown_connections 2024-09-10T23:01:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.591+0000 7f5ef3200640 1 -- 172.21.15.46:0/2592692847 wait complete. 2024-09-10T23:01:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.592+0000 7f5ef3200640 1 Processor -- start 2024-09-10T23:01:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.592+0000 7f5ef3200640 1 -- start start 2024-09-10T23:01:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5ef3200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eec102790 0x7f5eec076c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5ef3200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 0x7f5eec075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5ef3200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec10b480 con 0x7f5eec1038f0 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5ef3200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec10b300 con 0x7f5eec102790 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eeb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 0x7f5eec075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eeb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 0x7f5eec075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59310/0 (socket says 172.21.15.46:59310) 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eeb400640 1 -- 172.21.15.46:0/3743873657 learned_addr learned my addr 172.21.15.46:0/3743873657 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eebe00640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eec102790 0x7f5eec076c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eeb400640 1 -- 172.21.15.46:0/3743873657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eec102790 msgr2=0x7f5eec076c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eeb400640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eec102790 0x7f5eec076c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.593+0000 7f5eeb400640 1 -- 172.21.15.46:0/3743873657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec075a80 con 0x7f5eec1038f0 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.594+0000 7f5eeb400640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 0x7f5eec075540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800e970 tx=0x7f5ed800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.594+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed800cac0 con 0x7f5eec1038f0 2024-09-10T23:01:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.594+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ed80054b0 con 0x7f5eec1038f0 2024-09-10T23:01:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.594+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec075d70 con 0x7f5eec1038f0 2024-09-10T23:01:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.594+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed8004c40 con 0x7f5eec1038f0 2024-09-10T23:01:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.594+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec076380 con 0x7f5eec1038f0 2024-09-10T23:01:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.595+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec102b90 con 0x7f5eec1038f0 2024-09-10T23:01:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.597+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f5ed800cc60 con 0x7f5eec1038f0 2024-09-10T23:01:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.597+0000 7f5ee8c00640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5ed007a310 0x7f5ed007c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.598+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f5ed809d4c0 con 0x7f5eec1038f0 2024-09-10T23:01:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.598+0000 7f5eebe00640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5ed007a310 0x7f5ed007c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.598+0000 7f5eebe00640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5ed007a310 0x7f5ed007c7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5edc000c00 tx=0x7f5edc004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.602+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5ed8064e70 con 0x7f5eec1038f0 2024-09-10T23:01:21.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.880+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5eec063d50 con 0x7f5eec1038f0 2024-09-10T23:01:21.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.883+0000 7f5ee8c00640 1 -- 172.21.15.46:0/3743873657 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) ==== 170+0+59 (secure 0 0 0) 0x7f5ed8069250 con 0x7f5eec1038f0 2024-09-10T23:01:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-09-10T23:01:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDBz+BmOsWWNBAAAZ/mntqh2bKDfytpmP8D8A== 2024-09-10T23:01:21.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.885+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5ed007a310 msgr2=0x7f5ed007c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.885+0000 7f5ef3200640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5ed007a310 0x7f5ed007c7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5edc000c00 tx=0x7f5edc004d70 comp rx=0 tx=0).stop 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 msgr2=0x7f5eec075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 0x7f5eec075540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800e970 tx=0x7f5ed800ed70 comp rx=0 tx=0).stop 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 shutdown_connections 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5ed007a310 0x7f5ed007c7d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5eec1038f0 0x7f5eec075540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 --2- 172.21.15.46:0/3743873657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eec102790 0x7f5eec076c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 >> 172.21.15.46:0/3743873657 conn(0x7f5eec0fe060 msgr2=0x7f5eec106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 shutdown_connections 2024-09-10T23:01:21.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:21.886+0000 7f5ef3200640 1 -- 172.21.15.46:0/3743873657 wait complete. 2024-09-10T23:01:22.243 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:21 smithi046 ceph-mon[28128]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:22.243 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:21 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3743873657' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:01:22.243 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:21 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3743873657' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:01:22.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:21 smithi073 ceph-mon[35473]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:22.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:21 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3743873657' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:01:22.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:21 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3743873657' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:01:22.656 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T23:01:22.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T23:01:22.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:01:22.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T23:01:23.117 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi073/config 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 -- 172.21.15.73:0/3451123430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 msgr2=0x7f38e4104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 --2- 172.21.15.73:0/3451123430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e4104d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009880 tx=0x7f38d802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 -- 172.21.15.73:0/3451123430 shutdown_connections 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 --2- 172.21.15.73:0/3451123430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38e4105af0 0x7f38e4105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 --2- 172.21.15.73:0/3451123430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e4104d90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 -- 172.21.15.73:0/3451123430 >> 172.21.15.73:0/3451123430 conn(0x7f38e41002c0 msgr2=0x7f38e41026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 -- 172.21.15.73:0/3451123430 shutdown_connections 2024-09-10T23:01:23.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.688+0000 7f38ec200640 1 -- 172.21.15.73:0/3451123430 wait complete. 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.689+0000 7f38ec200640 1 Processor -- start 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.689+0000 7f38ec200640 1 -- start start 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.689+0000 7f38ec200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.689+0000 7f38ec200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38e4105af0 0x7f38e419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.689+0000 7f38ec200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f38e410d680 con 0x7f38e4105af0 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.689+0000 7f38ec200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38e410d500 con 0x7f38e4104990 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35262/0 (socket says 172.21.15.73:35262) 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 -- 172.21.15.73:0/2036500955 learned_addr learned my addr 172.21.15.73:0/2036500955 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e8e00640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38e4105af0 0x7f38e419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 -- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38e4105af0 msgr2=0x7f38e419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:23.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38e4105af0 0x7f38e419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 -- 172.21.15.73:0/2036500955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e419b6d0 con 0x7f38e4104990 2024-09-10T23:01:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.690+0000 7f38e9800640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e419a4b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38d80099a0 tx=0x7f38d8004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.691+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38d803f070 con 0x7f38e4104990 2024-09-10T23:01:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.691+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38d8004440 con 0x7f38e4104990 2024-09-10T23:01:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.691+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e419b960 con 0x7f38e4104990 2024-09-10T23:01:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.691+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38d8035030 con 0x7f38e4104990 2024-09-10T23:01:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.691+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e419bf10 con 0x7f38e4104990 2024-09-10T23:01:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.692+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e410ddd0 con 0x7f38e4104990 2024-09-10T23:01:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.693+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f38d8003c10 con 0x7f38e4104990 2024-09-10T23:01:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.694+0000 7f38e2000640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f38cc07a320 0x7f38cc07c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.694+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f38d80bdd80 con 0x7f38e4104990 2024-09-10T23:01:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.694+0000 7f38e8e00640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f38cc07a320 0x7f38cc07c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.695+0000 7f38e8e00640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f38cc07a320 0x7f38cc07c7e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38d0005fd0 tx=0x7f38d000b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:23.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.698+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f38d8089b10 con 0x7f38e4104990 2024-09-10T23:01:23.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.951+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f38e419c1c0 con 0x7f38e4104990 2024-09-10T23:01:23.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.956+0000 7f38e2000640 1 -- 172.21.15.73:0/2036500955 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v20) ==== 170+0+59 (secure 0 0 0) 0x7f38d808e530 con 0x7f38e4104990 2024-09-10T23:01:23.958 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-09-10T23:01:23.958 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDDz+BmVJLTOBAAtS3IDHzcEuebhmGVSndkXQ== 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f38cc07a320 msgr2=0x7f38cc07c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f38cc07a320 0x7f38cc07c7e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38d0005fd0 tx=0x7f38d000b390 comp rx=0 tx=0).stop 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 msgr2=0x7f38e419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e419a4b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38d80099a0 tx=0x7f38d8004040 comp rx=0 tx=0).stop 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 shutdown_connections 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f38cc07a320 0x7f38cc07c7e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38e4105af0 0x7f38e419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 --2- 172.21.15.73:0/2036500955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38e4104990 0x7f38e419a4b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 >> 172.21.15.73:0/2036500955 conn(0x7f38e41002c0 msgr2=0x7f38e4109000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:23.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 shutdown_connections 2024-09-10T23:01:23.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:01:23.959+0000 7f38ec200640 1 -- 172.21.15.73:0/2036500955 wait complete. 2024-09-10T23:01:24.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:23 smithi046 ceph-mon[28128]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:24.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:23 smithi046 ceph-mon[28128]: from='client.? 172.21.15.73:0/2036500955' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:01:24.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:23 smithi046 ceph-mon[28128]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:01:24.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:23 smithi046 ceph-mon[28128]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:01:24.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:23 smithi073 ceph-mon[35473]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:24.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:23 smithi073 ceph-mon[35473]: from='client.? 172.21.15.73:0/2036500955' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:01:24.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:23 smithi073 ceph-mon[35473]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:01:24.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:23 smithi073 ceph-mon[35473]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:01:24.813 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T23:01:24.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-10T23:01:24.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T23:01:24.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T23:01:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 -- 172.21.15.46:0/4123887593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 msgr2=0x7efe781087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 --2- 172.21.15.46:0/4123887593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe781087d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efe60009880 tx=0x7efe6002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 -- 172.21.15.46:0/4123887593 shutdown_connections 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 --2- 172.21.15.46:0/4123887593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe781087d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 --2- 172.21.15.46:0/4123887593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe78102980 0x7efe78102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 -- 172.21.15.46:0/4123887593 >> 172.21.15.46:0/4123887593 conn(0x7efe780fe3f0 msgr2=0x7efe78100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 -- 172.21.15.46:0/4123887593 shutdown_connections 2024-09-10T23:01:25.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.819+0000 7efe77e00640 1 -- 172.21.15.46:0/4123887593 wait complete. 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.820+0000 7efe77e00640 1 Processor -- start 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.820+0000 7efe77e00640 1 -- start start 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.820+0000 7efe77e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe78102980 0x7efe7819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.820+0000 7efe77e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe7819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.820+0000 7efe77e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efe7810fa30 con 0x7efe78108390 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.820+0000 7efe77e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efe7810f8b0 con 0x7efe78102980 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe7819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe7819ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36774/0 (socket says 172.21.15.46:36774) 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 -- 172.21.15.46:0/2968775377 learned_addr learned my addr 172.21.15.46:0/2968775377 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:25.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe76a00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe78102980 0x7efe7819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:25.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 -- 172.21.15.46:0/2968775377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe78102980 msgr2=0x7efe7819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:25.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe78102980 0x7efe7819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:25.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 -- 172.21.15.46:0/2968775377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe781a0130 con 0x7efe78108390 2024-09-10T23:01:25.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.821+0000 7efe6e000640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe7819ad90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efe60006010 tx=0x7efe600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:25.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.822+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe6003f070 con 0x7efe78108390 2024-09-10T23:01:25.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.822+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe600049d0 con 0x7efe78108390 2024-09-10T23:01:25.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.822+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe781a03c0 con 0x7efe78108390 2024-09-10T23:01:25.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.822+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe60035030 con 0x7efe78108390 2024-09-10T23:01:25.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.822+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe781a0970 con 0x7efe78108390 2024-09-10T23:01:25.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.823+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7819b510 con 0x7efe78108390 2024-09-10T23:01:25.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.824+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7efe60003b10 con 0x7efe78108390 2024-09-10T23:01:25.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.825+0000 7efe6fe00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efe5c07a370 0x7efe5c07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:25.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.825+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7efe600bdd00 con 0x7efe78108390 2024-09-10T23:01:25.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.825+0000 7efe76a00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efe5c07a370 0x7efe5c07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:25.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.826+0000 7efe76a00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efe5c07a370 0x7efe5c07c830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe68009890 tx=0x7efe68008040 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:25.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:25.829+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe7819b510 con 0x7efe78108390 2024-09-10T23:01:26.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.027+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7efe780ffee0 con 0x7efe78108390 2024-09-10T23:01:26.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.028+0000 7efe6fe00640 1 -- 172.21.15.46:0/2968775377 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v43) ==== 86+0+187 (secure 0 0 0) 0x7efe60085730 con 0x7efe78108390 2024-09-10T23:01:26.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efe5c07a370 msgr2=0x7efe5c07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efe5c07a370 0x7efe5c07c830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe68009890 tx=0x7efe68008040 comp rx=0 tx=0).stop 2024-09-10T23:01:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 msgr2=0x7efe7819ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe7819ad90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efe60006010 tx=0x7efe600045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 shutdown_connections 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efe5c07a370 0x7efe5c07c830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe78108390 0x7efe7819ad90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 --2- 172.21.15.46:0/2968775377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe78102980 0x7efe7819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.030+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 >> 172.21.15.46:0/2968775377 conn(0x7efe780fe3f0 msgr2=0x7efe78101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.031+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 shutdown_connections 2024-09-10T23:01:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:26.031+0000 7efe77e00640 1 -- 172.21.15.46:0/2968775377 wait complete. 2024-09-10T23:01:26.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:25 smithi046 ceph-mon[28128]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:26.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:25 smithi073 ceph-mon[35473]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:26.964 INFO:teuthology.orchestra.run.smithi046.stdout:[{"version":43,"timestamp":"2024-09-10T23:01:16.479836+0000","name":"","changes":[{"name":"osd/host:smithi073/osd_memory_target","previous_value":"5212742178","new_value":"3909556633"}]}] 2024-09-10T23:01:26.965 INFO:tasks.ceph_manager:config epoch is 43 2024-09-10T23:01:26.965 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:01:26.965 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:01:26.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T23:01:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:26 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2968775377' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:01:27.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:26 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2968775377' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:01:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:28.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 -- 172.21.15.46:0/1234724506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 msgr2=0x7fdf70077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:28.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1234724506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf70077ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdf600098b0 tx=0x7fdf6002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 -- 172.21.15.46:0/1234724506 shutdown_connections 2024-09-10T23:01:28.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1234724506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 0x7fdf70113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1234724506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf70077ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 -- 172.21.15.46:0/1234724506 >> 172.21.15.46:0/1234724506 conn(0x7fdf701005f0 msgr2=0x7fdf70102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:28.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 -- 172.21.15.46:0/1234724506 shutdown_connections 2024-09-10T23:01:28.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.086+0000 7fdf6f200640 1 -- 172.21.15.46:0/1234724506 wait complete. 2024-09-10T23:01:28.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.088+0000 7fdf6f200640 1 Processor -- start 2024-09-10T23:01:28.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.088+0000 7fdf6f200640 1 -- start start 2024-09-10T23:01:28.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.088+0000 7fdf6f200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf7019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:28.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.088+0000 7fdf6f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 0x7fdf7019f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:28.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.088+0000 7fdf6f200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70115f50 con 0x7fdf700776d0 2024-09-10T23:01:28.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.088+0000 7fdf6f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70115dd0 con 0x7fdf70077ff0 2024-09-10T23:01:28.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf7019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:28.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf7019eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36784/0 (socket says 172.21.15.46:36784) 2024-09-10T23:01:28.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 -- 172.21.15.46:0/1812805634 learned_addr learned my addr 172.21.15.46:0/1812805634 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:28.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6d400640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 0x7fdf7019f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:28.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 -- 172.21.15.46:0/1812805634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 msgr2=0x7fdf7019f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 0x7fdf7019f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 -- 172.21.15.46:0/1812805634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf701a43d0 con 0x7fdf700776d0 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6d400640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 0x7fdf7019f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.089+0000 7fdf6de00640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf7019eaf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009230 tx=0x7fdf600045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.090+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf6003f070 con 0x7fdf700776d0 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.090+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf60004a50 con 0x7fdf700776d0 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.090+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf60035030 con 0x7fdf700776d0 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.090+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf701a46c0 con 0x7fdf700776d0 2024-09-10T23:01:28.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.090+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf701a4cd0 con 0x7fdf700776d0 2024-09-10T23:01:28.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.091+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7019f7b0 con 0x7fdf700776d0 2024-09-10T23:01:28.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.092+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fdf60003c10 con 0x7fdf700776d0 2024-09-10T23:01:28.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.093+0000 7fdf66a00640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fdf5407a320 0x7fdf5407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:28.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.093+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fdf600bdd50 con 0x7fdf700776d0 2024-09-10T23:01:28.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.093+0000 7fdf6d400640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fdf5407a320 0x7fdf5407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:28.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.094+0000 7fdf6d400640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fdf5407a320 0x7fdf5407c7e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf70102c70 tx=0x7fdf5c00a5c0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:28.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.097+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf7019f7b0 con 0x7fdf700776d0 2024-09-10T23:01:28.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:28 smithi046 ceph-mon[28128]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:28.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:28 smithi073 ceph-mon[35473]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.343+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdf70110710 con 0x7fdf700776d0 2024-09-10T23:01:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.347+0000 7fdf66a00640 1 -- 172.21.15.46:0/1812805634 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+196684 (secure 0 0 0) 0x7fdf60085700 con 0x7fdf700776d0 2024-09-10T23:01:28.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fdf5407a320 msgr2=0x7fdf5407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fdf5407a320 0x7fdf5407c7e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf70102c70 tx=0x7fdf5c00a5c0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 msgr2=0x7fdf7019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf7019eaf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009230 tx=0x7fdf600045c0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 shutdown_connections 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fdf5407a320 0x7fdf5407c7e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70077ff0 0x7fdf7019f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 --2- 172.21.15.46:0/1812805634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf700776d0 0x7fdf7019eaf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 >> 172.21.15.46:0/1812805634 conn(0x7fdf701005f0 msgr2=0x7fdf701011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 shutdown_connections 2024-09-10T23:01:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:28.350+0000 7fdf6f200640 1 -- 172.21.15.46:0/1812805634 wait complete. 2024-09-10T23:01:29.168 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"flags":0,"active_gid":14227,"active_name":"smithi046.eocvws","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":3534556395},{"type":"v1","addr":"172.21.15.46:6801","nonce":3534556395}]},"active_addr":"172.21.15.46:6801/3534556395","active_change":"2024-09-10T22:55:30.890957+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":14256,"name":"smithi073.lkiuuj","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/","prometheus":"http://172.21.15.46:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3383946862}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":356206435}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":166717480}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1240983156}]}]} 2024-09-10T23:01:29.172 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T23:01:29.172 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T23:01:29.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:01:29.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:29 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1812805634' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:01:29.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:29 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1812805634' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:01:29.554 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 -- 172.21.15.46:0/1627652092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0101083a0 msgr2=0x7fd0101087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 --2- 172.21.15.46:0/1627652092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0101083a0 0x7fd0101087e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009880 tx=0x7fcff802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 -- 172.21.15.46:0/1627652092 shutdown_connections 2024-09-10T23:01:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 --2- 172.21.15.46:0/1627652092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0101083a0 0x7fd0101087e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 --2- 172.21.15.46:0/1627652092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd010102990 0x7fd010102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 -- 172.21.15.46:0/1627652092 >> 172.21.15.46:0/1627652092 conn(0x7fd0100fe3e0 msgr2=0x7fd010100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:30.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 -- 172.21.15.46:0/1627652092 shutdown_connections 2024-09-10T23:01:30.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.142+0000 7fd015000640 1 -- 172.21.15.46:0/1627652092 wait complete. 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.143+0000 7fd015000640 1 Processor -- start 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.143+0000 7fd015000640 1 -- start start 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd015000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 0x7fd010198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd015000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0101083a0 0x7fd010198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd015000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd01010f9e0 con 0x7fd010102990 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd015000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd01010f860 con 0x7fd0101083a0 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd00f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 0x7fd010198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd00f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 0x7fd010198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36796/0 (socket says 172.21.15.46:36796) 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd00f400640 1 -- 172.21.15.46:0/1806090972 learned_addr learned my addr 172.21.15.46:0/1806090972 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.144+0000 7fd006a00640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0101083a0 0x7fd010198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:30.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00f400640 1 -- 172.21.15.46:0/1806090972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0101083a0 msgr2=0x7fd010198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:30.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00f400640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0101083a0 0x7fd010198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00f400640 1 -- 172.21.15.46:0/1806090972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01019de60 con 0x7fd010102990 2024-09-10T23:01:30.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd006a00640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0101083a0 0x7fd010198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00f400640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 0x7fd010198580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ea00 tx=0x7fd00000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd00000cb80 con 0x7fd010102990 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd00000cd20 con 0x7fd010102990 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01019e150 con 0x7fd010102990 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd000011470 con 0x7fd010102990 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.145+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01019e760 con 0x7fd010102990 2024-09-10T23:01:30.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.146+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd010199240 con 0x7fd010102990 2024-09-10T23:01:30.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.147+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fd00000f040 con 0x7fd010102990 2024-09-10T23:01:30.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.148+0000 7fd00cc00640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fcff407a320 0x7fcff407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:30.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.148+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fd00009d070 con 0x7fd010102990 2024-09-10T23:01:30.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.149+0000 7fd006a00640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fcff407a320 0x7fcff407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:30.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.149+0000 7fd006a00640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fcff407a320 0x7fcff407c7e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd010107070 tx=0x7fcff8005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:30.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.153+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd010199240 con 0x7fd010102990 2024-09-10T23:01:30.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:30 smithi046 ceph-mon[28128]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:30.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:30 smithi073 ceph-mon[35473]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:30.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.355+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd01010ab40 con 0x7fd010102990 2024-09-10T23:01:30.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.356+0000 7fd00cc00640 1 -- 172.21.15.46:0/1806090972 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+13868 (secure 0 0 0) 0x7fd000016030 con 0x7fd010102990 2024-09-10T23:01:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:30.358 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","created":"2024-09-10T22:53:11.794585+0000","modified":"2024-09-10T23:01:15.971073+0000","last_up_change":"2024-09-10T23:01:13.959042+0000","last_in_change":"2024-09-10T23:00:49.264739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:58:33.387526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5460ef41-5ff6-4583-8410-9f83bcd495f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6803","nonce":2885579696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6805","nonce":2885579696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6809","nonce":2885579696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6807","nonce":2885579696}]},"public_addr":"172.21.15.46:6803/2885579696","cluster_addr":"172.21.15.46:6805/2885579696","heartbeat_back_addr":"172.21.15.46:6809/2885579696","heartbeat_front_addr":"172.21.15.46:6807/2885579696","state":["exists","up"]},{"osd":1,"uuid":"294d3916-f4c1-42a6-bfd4-7430ca8b8c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6811","nonce":3611441892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6813","nonce":3611441892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6817","nonce":3611441892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6815","nonce":3611441892}]},"public_addr":"172.21.15.46:6811/3611441892","cluster_addr":"172.21.15.46:6813/3611441892","heartbeat_back_addr":"172.21.15.46:6817/3611441892","heartbeat_front_addr":"172.21.15.46:6815/3611441892","state":["exists","up"]},{"osd":2,"uuid":"7cfa1ba4-f5c8-4efc-b923-73a99fad468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6819","nonce":3774780724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6821","nonce":3774780724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6825","nonce":3774780724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6823","nonce":3774780724}]},"public_addr":"172.21.15.46:6819/3774780724","cluster_addr":"172.21.15.46:6821/3774780724","heartbeat_back_addr":"172.21.15.46:6825/3774780724","heartbeat_front_addr":"172.21.15.46:6823/3774780724","state":["exists","up"]},{"osd":3,"uuid":"8575c985-20a6-4edb-8186-e502888ef174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6827","nonce":1627285252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6829","nonce":1627285252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6833","nonce":1627285252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6831","nonce":1627285252}]},"public_addr":"172.21.15.46:6827/1627285252","cluster_addr":"172.21.15.46:6829/1627285252","heartbeat_back_addr":"172.21.15.46:6833/1627285252","heartbeat_front_addr":"172.21.15.46:6831/1627285252","state":["exists","up"]},{"osd":4,"uuid":"5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6801","nonce":4123471774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6803","nonce":4123471774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6807","nonce":4123471774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6805","nonce":4123471774}]},"public_addr":"172.21.15.73:6801/4123471774","cluster_addr":"172.21.15.73:6803/4123471774","heartbeat_back_addr":"172.21.15.73:6807/4123471774","heartbeat_front_addr":"172.21.15.73:6805/4123471774","state":["exists","up"]},{"osd":5,"uuid":"84431538-dde7-43ca-94c2-ec8a3ce72421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6809","nonce":3681064684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6811","nonce":3681064684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6815","nonce":3681064684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6813","nonce":3681064684}]},"public_addr":"172.21.15.73:6809/3681064684","cluster_addr":"172.21.15.73:6811/3681064684","heartbeat_back_addr":"172.21.15.73:6815/3681064684","heartbeat_front_addr":"172.21.15.73:6813/3681064684","state":["exists","up"]},{"osd":6,"uuid":"c5725994-7afe-4abf-b961-99b13c47a55b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6817","nonce":2364854184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6819","nonce":2364854184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6823","nonce":2364854184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6821","nonce":2364854184}]},"public_addr":"172.21.15.73:6817/2364854184","cluster_addr":"172.21.15.73:6819/2364854184","heartbeat_back_addr":"172.21.15.73:6823/2364854184","heartbeat_front_addr":"172.21.15.73:6821/2364854184","state":["exists","up"]},{"osd":7,"uuid":"44eb7536-2797-402a-8041-e0b97cac2cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6825","nonce":1690062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6827","nonce":1690062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6831","nonce":1690062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6829","nonce":1690062257}]},"public_addr":"172.21.15.73:6825/1690062257","cluster_addr":"172.21.15.73:6827/1690062257","heartbeat_back_addr":"172.21.15.73:6831/1690062257","heartbeat_front_addr":"172.21.15.73:6829/1690062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:23.184934+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:57.854549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:58:30.670491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:02.736727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:33.037689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:06.105862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:39.985408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:01:12.056861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3052523989":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6801/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/2163720030":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/220137103":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/3240682838":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/263522480":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/1989006756":"2024-09-11T22:53:39.482819+0000","172.21.15.46:6800/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6800/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6800/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/1231598076":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/1514329312":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/2623235150":"2024-09-11T22:55:30.890832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:01:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fcff407a320 msgr2=0x7fcff407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fcff407a320 0x7fcff407c7e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd010107070 tx=0x7fcff8005a20 comp rx=0 tx=0).stop 2024-09-10T23:01:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 msgr2=0x7fd010198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 0x7fd010198580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ea00 tx=0x7fd00000eec0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 shutdown_connections 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fcff407a320 0x7fcff407c7e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0101083a0 0x7fd010198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 --2- 172.21.15.46:0/1806090972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd010102990 0x7fd010198580 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.358+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 >> 172.21.15.46:0/1806090972 conn(0x7fd0100fe3e0 msgr2=0x7fd0101007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.359+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 shutdown_connections 2024-09-10T23:01:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:30.359+0000 7fd015000640 1 -- 172.21.15.46:0/1806090972 wait complete. 2024-09-10T23:01:31.155 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T23:01:31.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:01:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:31 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1806090972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:01:31.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:31 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1806090972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:01:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 -- 172.21.15.46:0/659476959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c06ad20 msgr2=0x7fd82c06b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 --2- 172.21.15.46:0/659476959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c06ad20 0x7fd82c06b160 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd818009880 tx=0x7fd81802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 -- 172.21.15.46:0/659476959 shutdown_connections 2024-09-10T23:01:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 --2- 172.21.15.46:0/659476959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c06ad20 0x7fd82c06b160 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 --2- 172.21.15.46:0/659476959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c1034c0 0x7fd82c06a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 -- 172.21.15.46:0/659476959 >> 172.21.15.46:0/659476959 conn(0x7fd82c076150 msgr2=0x7fd82c0799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:32.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 -- 172.21.15.46:0/659476959 shutdown_connections 2024-09-10T23:01:32.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.141+0000 7fd832e00640 1 -- 172.21.15.46:0/659476959 wait complete. 2024-09-10T23:01:32.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.142+0000 7fd832e00640 1 Processor -- start 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.142+0000 7fd832e00640 1 -- start start 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd832e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c06ad20 0x7fd82c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd832e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 0x7fd82c19acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd832e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c111b90 con 0x7fd82c1034c0 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd832e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c111a10 con 0x7fd82c06ad20 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 0x7fd82c19acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 0x7fd82c19acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36806/0 (socket says 172.21.15.46:36806) 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831000640 1 -- 172.21.15.46:0/3332387365 learned_addr learned my addr 172.21.15.46:0/3332387365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831a00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c06ad20 0x7fd82c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831000640 1 -- 172.21.15.46:0/3332387365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c06ad20 msgr2=0x7fd82c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831000640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c06ad20 0x7fd82c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.143+0000 7fd831000640 1 -- 172.21.15.46:0/3332387365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c1a0070 con 0x7fd82c1034c0 2024-09-10T23:01:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.144+0000 7fd831000640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 0x7fd82c19acd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd818006010 tx=0x7fd8180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.144+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd81803f070 con 0x7fd82c1034c0 2024-09-10T23:01:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.144+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8180049d0 con 0x7fd82c1034c0 2024-09-10T23:01:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.144+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd818035030 con 0x7fd82c1034c0 2024-09-10T23:01:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.144+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c1a0300 con 0x7fd82c1034c0 2024-09-10T23:01:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.144+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c1a08b0 con 0x7fd82c1034c0 2024-09-10T23:01:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.145+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd82c19b450 con 0x7fd82c1034c0 2024-09-10T23:01:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.147+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fd818003b10 con 0x7fd82c1034c0 2024-09-10T23:01:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.147+0000 7fd82a000640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd81407a370 0x7fd81407c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.148+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fd8180bdc70 con 0x7fd82c1034c0 2024-09-10T23:01:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.148+0000 7fd831a00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd81407a370 0x7fd81407c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:32.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.148+0000 7fd831a00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd81407a370 0x7fd81407c830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd820007ec0 tx=0x7fd8200075b0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:32.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.152+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd82c19b450 con 0x7fd82c1034c0 2024-09-10T23:01:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:32 smithi046 ceph-mon[28128]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:32.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:32 smithi073 ceph-mon[35473]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.349+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd82c1a0b60 con 0x7fd82c1034c0 2024-09-10T23:01:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.350+0000 7fd82a000640 1 -- 172.21.15.46:0/3332387365 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+13868 (secure 0 0 0) 0x7fd8180c4080 con 0x7fd82c1034c0 2024-09-10T23:01:32.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:32.352 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":52,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","created":"2024-09-10T22:53:11.794585+0000","modified":"2024-09-10T23:01:15.971073+0000","last_up_change":"2024-09-10T23:01:13.959042+0000","last_in_change":"2024-09-10T23:00:49.264739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:58:33.387526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5460ef41-5ff6-4583-8410-9f83bcd495f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6803","nonce":2885579696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6805","nonce":2885579696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6809","nonce":2885579696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6807","nonce":2885579696}]},"public_addr":"172.21.15.46:6803/2885579696","cluster_addr":"172.21.15.46:6805/2885579696","heartbeat_back_addr":"172.21.15.46:6809/2885579696","heartbeat_front_addr":"172.21.15.46:6807/2885579696","state":["exists","up"]},{"osd":1,"uuid":"294d3916-f4c1-42a6-bfd4-7430ca8b8c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6811","nonce":3611441892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6813","nonce":3611441892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6817","nonce":3611441892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6815","nonce":3611441892}]},"public_addr":"172.21.15.46:6811/3611441892","cluster_addr":"172.21.15.46:6813/3611441892","heartbeat_back_addr":"172.21.15.46:6817/3611441892","heartbeat_front_addr":"172.21.15.46:6815/3611441892","state":["exists","up"]},{"osd":2,"uuid":"7cfa1ba4-f5c8-4efc-b923-73a99fad468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6819","nonce":3774780724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6821","nonce":3774780724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6825","nonce":3774780724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6823","nonce":3774780724}]},"public_addr":"172.21.15.46:6819/3774780724","cluster_addr":"172.21.15.46:6821/3774780724","heartbeat_back_addr":"172.21.15.46:6825/3774780724","heartbeat_front_addr":"172.21.15.46:6823/3774780724","state":["exists","up"]},{"osd":3,"uuid":"8575c985-20a6-4edb-8186-e502888ef174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6827","nonce":1627285252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6829","nonce":1627285252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6833","nonce":1627285252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6831","nonce":1627285252}]},"public_addr":"172.21.15.46:6827/1627285252","cluster_addr":"172.21.15.46:6829/1627285252","heartbeat_back_addr":"172.21.15.46:6833/1627285252","heartbeat_front_addr":"172.21.15.46:6831/1627285252","state":["exists","up"]},{"osd":4,"uuid":"5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6801","nonce":4123471774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6803","nonce":4123471774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6807","nonce":4123471774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6805","nonce":4123471774}]},"public_addr":"172.21.15.73:6801/4123471774","cluster_addr":"172.21.15.73:6803/4123471774","heartbeat_back_addr":"172.21.15.73:6807/4123471774","heartbeat_front_addr":"172.21.15.73:6805/4123471774","state":["exists","up"]},{"osd":5,"uuid":"84431538-dde7-43ca-94c2-ec8a3ce72421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6809","nonce":3681064684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6811","nonce":3681064684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6815","nonce":3681064684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6813","nonce":3681064684}]},"public_addr":"172.21.15.73:6809/3681064684","cluster_addr":"172.21.15.73:6811/3681064684","heartbeat_back_addr":"172.21.15.73:6815/3681064684","heartbeat_front_addr":"172.21.15.73:6813/3681064684","state":["exists","up"]},{"osd":6,"uuid":"c5725994-7afe-4abf-b961-99b13c47a55b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6817","nonce":2364854184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6819","nonce":2364854184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6823","nonce":2364854184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6821","nonce":2364854184}]},"public_addr":"172.21.15.73:6817/2364854184","cluster_addr":"172.21.15.73:6819/2364854184","heartbeat_back_addr":"172.21.15.73:6823/2364854184","heartbeat_front_addr":"172.21.15.73:6821/2364854184","state":["exists","up"]},{"osd":7,"uuid":"44eb7536-2797-402a-8041-e0b97cac2cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6825","nonce":1690062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6827","nonce":1690062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6831","nonce":1690062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6829","nonce":1690062257}]},"public_addr":"172.21.15.73:6825/1690062257","cluster_addr":"172.21.15.73:6827/1690062257","heartbeat_back_addr":"172.21.15.73:6831/1690062257","heartbeat_front_addr":"172.21.15.73:6829/1690062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:23.184934+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:57.854549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:58:30.670491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:02.736727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:33.037689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:06.105862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:39.985408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:01:12.056861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3052523989":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6801/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/2163720030":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/220137103":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/3240682838":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/263522480":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/1989006756":"2024-09-11T22:53:39.482819+0000","172.21.15.46:6800/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6800/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6800/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/1231598076":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/1514329312":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/2623235150":"2024-09-11T22:55:30.890832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:01:32.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd81407a370 msgr2=0x7fd81407c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd81407a370 0x7fd81407c830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd820007ec0 tx=0x7fd8200075b0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 msgr2=0x7fd82c19acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 0x7fd82c19acd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd818006010 tx=0x7fd8180045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 shutdown_connections 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd81407a370 0x7fd81407c830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c1034c0 0x7fd82c19acd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 --2- 172.21.15.46:0/3332387365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c06ad20 0x7fd82c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 >> 172.21.15.46:0/3332387365 conn(0x7fd82c076150 msgr2=0x7fd82c0ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 shutdown_connections 2024-09-10T23:01:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:32.353+0000 7fd832e00640 1 -- 172.21.15.46:0/3332387365 wait complete. 2024-09-10T23:01:33.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T23:01:33.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T23:01:33.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T23:01:33.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T23:01:33.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T23:01:33.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T23:01:33.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T23:01:33.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T23:01:33.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:33 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3332387365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:01:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:33 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3332387365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:01:33.839 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.855 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.855 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.855 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.857 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:34.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:34 smithi046 ceph-mon[28128]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:34.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:34 smithi073 ceph-mon[35473]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 -- 172.21.15.46:0/2789945944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca4102990 msgr2=0x7f9ca4102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 --2- 172.21.15.46:0/2789945944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca4102990 0x7f9ca4102d70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009880 tx=0x7f9c9802a4b0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 -- 172.21.15.46:0/2789945944 shutdown_connections 2024-09-10T23:01:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 --2- 172.21.15.46:0/2789945944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca41083a0 0x7f9ca41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 --2- 172.21.15.46:0/2789945944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca4102990 0x7f9ca4102d70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 -- 172.21.15.46:0/2789945944 >> 172.21.15.46:0/2789945944 conn(0x7f9ca40fe3e0 msgr2=0x7f9ca4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 -- 172.21.15.46:0/2789945944 shutdown_connections 2024-09-10T23:01:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.243+0000 7f9caae00640 1 -- 172.21.15.46:0/2789945944 wait complete. 2024-09-10T23:01:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.244+0000 7f9caae00640 1 Processor -- start 2024-09-10T23:01:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.245+0000 7f9caae00640 1 -- start start 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.245+0000 7f9caae00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca4102990 0x7f9ca40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.245+0000 7f9caae00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 0x7f9ca40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.245+0000 7f9caae00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410f9c0 con 0x7f9ca41083a0 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.245+0000 7f9caae00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410f840 con 0x7f9ca4102990 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 0x7f9ca40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 0x7f9ca40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60602/0 (socket says 172.21.15.46:60602) 2024-09-10T23:01:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9000640 1 -- 172.21.15.46:0/1107811359 learned_addr learned my addr 172.21.15.46:0/1107811359 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9a00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca4102990 0x7f9ca40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9000640 1 -- 172.21.15.46:0/1107811359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca4102990 msgr2=0x7f9ca40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9000640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca4102990 0x7f9ca40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9000640 1 -- 172.21.15.46:0/1107811359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca4075f20 con 0x7f9ca41083a0 2024-09-10T23:01:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.246+0000 7f9ca9a00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca4102990 0x7f9ca40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:01:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.247+0000 7f9ca9000640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 0x7f9ca40759e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c8a0 tx=0x7f9c9000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.247+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c900079b0 con 0x7f9ca41083a0 2024-09-10T23:01:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.247+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca4076210 con 0x7f9ca41083a0 2024-09-10T23:01:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.247+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c9000f450 con 0x7f9ca41083a0 2024-09-10T23:01:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.247+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c90018630 con 0x7f9ca41083a0 2024-09-10T23:01:35.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.248+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41a49b0 con 0x7f9ca41083a0 2024-09-10T23:01:35.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.250+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ca40637e0 con 0x7f9ca41083a0 2024-09-10T23:01:35.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.250+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f9c900187d0 con 0x7f9ca41083a0 2024-09-10T23:01:35.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.251+0000 7f9ca2000640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9c8c07a370 0x7f9c8c07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:35.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.252+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f9c9009cfe0 con 0x7f9ca41083a0 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.252+0000 7f9ca9a00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9c8c07a370 0x7f9c8c07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.252+0000 7f9ca2000640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] conn(0x7f9c8c080730 0x7f9c8c082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.252+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 --> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c8c083200 con 0x7f9c8c080730 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.252+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f9c900a4050 con 0x7f9ca41083a0 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.252+0000 7f9caa400640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] conn(0x7f9c8c080730 0x7f9c8c082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.253+0000 7f9ca9a00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9c8c07a370 0x7f9c8c07c830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c98000c00 tx=0x7f9c98005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.253+0000 7f9caa400640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] conn(0x7f9c8c080730 0x7f9c8c082b50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.254+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== osd.3 v2:172.21.15.46:6826/1627285252 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c8c083200 con 0x7f9c8c080730 2024-09-10T23:01:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.268+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 --> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ca4063c60 con 0x7f9c8c080730 2024-09-10T23:01:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.268+0000 7f9ca2000640 1 -- 172.21.15.46:0/1107811359 <== osd.3 v2:172.21.15.46:6826/1627285252 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9ca4063c60 con 0x7f9c8c080730 2024-09-10T23:01:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.268+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] conn(0x7f9c8c080730 msgr2=0x7f9c8c082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.268+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] conn(0x7f9c8c080730 0x7f9c8c082b50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9c8c07a370 msgr2=0x7f9c8c07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9c8c07a370 0x7f9c8c07c830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c98000c00 tx=0x7f9c98005a20 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 msgr2=0x7f9ca40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 0x7f9ca40759e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c8a0 tx=0x7f9c9000cd60 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 shutdown_connections 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9c8c07a370 0x7f9c8c07c830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:6826/1627285252,v1:172.21.15.46:6827/1627285252] conn(0x7f9c8c080730 0x7f9c8c082b50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ca41083a0 0x7f9ca40759e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 --2- 172.21.15.46:0/1107811359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ca4102990 0x7f9ca40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 >> 172.21.15.46:0/1107811359 conn(0x7f9ca40fe3e0 msgr2=0x7f9ca40fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 shutdown_connections 2024-09-10T23:01:35.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.269+0000 7f9caae00640 1 -- 172.21.15.46:0/1107811359 wait complete. 2024-09-10T23:01:36.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 -- 172.21.15.46:0/1754951123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 msgr2=0x7f8a54102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 --2- 172.21.15.46:0/1754951123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54102d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009880 tx=0x7f8a4402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 -- 172.21.15.46:0/1754951123 shutdown_connections 2024-09-10T23:01:36.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 --2- 172.21.15.46:0/1754951123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 0x7f8a541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 --2- 172.21.15.46:0/1754951123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54102d70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 -- 172.21.15.46:0/1754951123 >> 172.21.15.46:0/1754951123 conn(0x7f8a540fe3e0 msgr2=0x7f8a54100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:36.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 -- 172.21.15.46:0/1754951123 shutdown_connections 2024-09-10T23:01:36.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.014+0000 7f8a53e00640 1 -- 172.21.15.46:0/1754951123 wait complete. 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.015+0000 7f8a53e00640 1 Processor -- start 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.015+0000 7f8a53e00640 1 -- start start 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a53e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a53e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 0x7f8a54198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a53e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5410f9c0 con 0x7f8a54102990 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a53e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5410f840 con 0x7f8a541083a0 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 0x7f8a54198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60634/0 (socket says 172.21.15.46:60634) 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52a00640 1 -- 172.21.15.46:0/3144204736 learned_addr learned my addr 172.21.15.46:0/3144204736 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52000640 1 -- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 msgr2=0x7f8a54198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52000640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.016+0000 7f8a52000640 1 -- 172.21.15.46:0/3144204736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5419df40 con 0x7f8a541083a0 2024-09-10T23:01:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.017+0000 7f8a52000640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 0x7f8a54198ba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a40005fd0 tx=0x7f8a4000dd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.017+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a4000be30 con 0x7f8a541083a0 2024-09-10T23:01:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.017+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5419e230 con 0x7f8a541083a0 2024-09-10T23:01:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.017+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a40004030 con 0x7f8a541083a0 2024-09-10T23:01:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.017+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a40003b50 con 0x7f8a541083a0 2024-09-10T23:01:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.017+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5419e7c0 con 0x7f8a541083a0 2024-09-10T23:01:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.018+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a5419ecc0 con 0x7f8a541083a0 2024-09-10T23:01:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.020+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f8a40023060 con 0x7f8a541083a0 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.021+0000 7f8a58a00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3807a370 0x7f8a3807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.021+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f8a4009c810 con 0x7f8a541083a0 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.021+0000 7f8a52a00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3807a370 0x7f8a3807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.021+0000 7f8a58a00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] conn(0x7f8a38080730 0x7f8a38082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.021+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 --> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a38083200 con 0x7f8a38080730 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.021+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8a4009cc10 con 0x7f8a541083a0 2024-09-10T23:01:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.022+0000 7f8a53400640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] conn(0x7f8a38080730 0x7f8a38082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.022+0000 7f8a52a00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3807a370 0x7f8a3807c830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a440096c0 tx=0x7f8a44004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:36.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.022+0000 7f8a53400640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] conn(0x7f8a38080730 0x7f8a38082b50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.023+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== osd.5 v2:172.21.15.73:6808/3681064684 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a38083200 con 0x7f8a38080730 2024-09-10T23:01:36.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.038+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 --> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a54063810 con 0x7f8a38080730 2024-09-10T23:01:36.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.038+0000 7f8a58a00640 1 -- 172.21.15.46:0/3144204736 <== osd.5 v2:172.21.15.73:6808/3681064684 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8a54063810 con 0x7f8a38080730 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] conn(0x7f8a38080730 msgr2=0x7f8a38082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] conn(0x7f8a38080730 0x7f8a38082b50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3807a370 msgr2=0x7f8a3807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3807a370 0x7f8a3807c830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a440096c0 tx=0x7f8a44004d70 comp rx=0 tx=0).stop 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 msgr2=0x7f8a54198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 0x7f8a54198ba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a40005fd0 tx=0x7f8a4000dd60 comp rx=0 tx=0).stop 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 shutdown_connections 2024-09-10T23:01:36.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:6808/3681064684,v1:172.21.15.73:6809/3681064684] conn(0x7f8a38080730 0x7f8a38082b50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8a3807a370 0x7f8a3807c830 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a541083a0 0x7f8a54198ba0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 --2- 172.21.15.46:0/3144204736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a54102990 0x7f8a54198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 >> 172.21.15.46:0/3144204736 conn(0x7f8a540fe3e0 msgr2=0x7f8a540fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 shutdown_connections 2024-09-10T23:01:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:36.039+0000 7f8a53e00640 1 -- 172.21.15.46:0/3144204736 wait complete. 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.108+0000 7fe315c00640 1 -- 172.21.15.46:0/463269829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310103a60 msgr2=0x7fe310103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.108+0000 7fe315c00640 1 --2- 172.21.15.46:0/463269829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310103a60 0x7fe310103e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe300009c20 tx=0x7fe30002a970 comp rx=0 tx=0).stop 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.108+0000 7fe315c00640 1 -- 172.21.15.46:0/463269829 shutdown_connections 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.108+0000 7fe315c00640 1 --2- 172.21.15.46:0/463269829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310104380 0x7fe31010c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.108+0000 7fe315c00640 1 --2- 172.21.15.46:0/463269829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310103a60 0x7fe310103e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.108+0000 7fe315c00640 1 -- 172.21.15.46:0/463269829 >> 172.21.15.46:0/463269829 conn(0x7fe3100fd4e0 msgr2=0x7fe3100ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.109+0000 7fe315c00640 1 -- 172.21.15.46:0/463269829 shutdown_connections 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.109+0000 7fe315c00640 1 -- 172.21.15.46:0/463269829 wait complete. 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.110+0000 7fe315c00640 1 Processor -- start 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.110+0000 7fe315c00640 1 -- start start 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.110+0000 7fe315c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310103a60 0x7fe310198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.110+0000 7fe315c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 0x7fe310198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.110+0000 7fe315c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe31010fba0 con 0x7fe310104380 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.110+0000 7fe315c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe31010fa20 con 0x7fe310103a60 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 0x7fe310198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 0x7fe310198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60576/0 (socket says 172.21.15.46:60576) 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 -- 172.21.15.46:0/4095688465 learned_addr learned my addr 172.21.15.46:0/4095688465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe30ea00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310103a60 0x7fe310198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 -- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310103a60 msgr2=0x7fe310198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310103a60 0x7fe310198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 -- 172.21.15.46:0/4095688465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31019e120 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe30ea00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310103a60 0x7fe310198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.111+0000 7fe306000640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 0x7fe310198d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800e940 tx=0x7fe2f800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.112+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f8004030 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.112+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31019e410 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.112+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2f800c8b0 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.112+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f8003b50 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.112+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31019e9a0 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.113+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe31006b660 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.114+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fe2f800ca60 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.115+0000 7fe307e00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2f407a370 0x7fe2f407c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.115+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fe2f809d5a0 con 0x7fe310104380 2024-09-10T23:01:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.115+0000 7fe30ea00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2f407a370 0x7fe2f407c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.116+0000 7fe307e00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] conn(0x7fe2f4080730 0x7fe2f4082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.116+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 --> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2f4083200 con 0x7fe2f4080730 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.116+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe2f80a4050 con 0x7fe310104380 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.116+0000 7fe30f400640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] conn(0x7fe2f4080730 0x7fe2f4082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.116+0000 7fe30ea00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2f407a370 0x7fe2f407c830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe300005e30 tx=0x7fe300009800 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.117+0000 7fe30f400640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] conn(0x7fe2f4080730 0x7fe2f4082b50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.118+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== osd.4 v2:172.21.15.73:6800/4123471774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2f4083200 con 0x7fe2f4080730 2024-09-10T23:01:36.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.148+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 --> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe31019ef80 con 0x7fe2f4080730 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe307e00640 1 -- 172.21.15.46:0/4095688465 <== osd.4 v2:172.21.15.73:6800/4123471774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe31019ef80 con 0x7fe2f4080730 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] conn(0x7fe2f4080730 msgr2=0x7fe2f4082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] conn(0x7fe2f4080730 0x7fe2f4082b50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2f407a370 msgr2=0x7fe2f407c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2f407a370 0x7fe2f407c830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe300005e30 tx=0x7fe300009800 comp rx=0 tx=0).stop 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 msgr2=0x7fe310198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.149+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 0x7fe310198d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800e940 tx=0x7fe2f800ee00 comp rx=0 tx=0).stop 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 shutdown_connections 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:6800/4123471774,v1:172.21.15.73:6801/4123471774] conn(0x7fe2f4080730 0x7fe2f4082b50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe2f407a370 0x7fe2f407c830 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe310104380 0x7fe310198d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 --2- 172.21.15.46:0/4095688465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe310103a60 0x7fe310198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:36.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 >> 172.21.15.46:0/4095688465 conn(0x7fe3100fd4e0 msgr2=0x7fe310107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:36.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 shutdown_connections 2024-09-10T23:01:36.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:35.150+0000 7fe315c00640 1 -- 172.21.15.46:0/4095688465 wait complete. 2024-09-10T23:01:36.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:36 smithi046 ceph-mon[28128]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:36.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:36 smithi073 ceph-mon[35473]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 -- 172.21.15.46:0/1772000035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 msgr2=0x7fb99c10a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 --2- 172.21.15.46:0/1772000035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c10a9e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb984009880 tx=0x7fb98402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 -- 172.21.15.46:0/1772000035 shutdown_connections 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 --2- 172.21.15.46:0/1772000035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c10a9e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 --2- 172.21.15.46:0/1772000035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb99c104b90 0x7fb99c104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 -- 172.21.15.46:0/1772000035 >> 172.21.15.46:0/1772000035 conn(0x7fb99c1005e0 msgr2=0x7fb99c102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.065+0000 7fb9a1800640 1 -- 172.21.15.46:0/1772000035 shutdown_connections 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.066+0000 7fb9a1800640 1 -- 172.21.15.46:0/1772000035 wait complete. 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.067+0000 7fb9a1800640 1 Processor -- start 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.067+0000 7fb9a1800640 1 -- start start 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb9a1800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb99c104b90 0x7fb99c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb9a1800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb9a1800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c111bc0 con 0x7fb99c10a5a0 2024-09-10T23:01:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb9a1800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c111a40 con 0x7fb99c104b90 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb993e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb993e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c19ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60660/0 (socket says 172.21.15.46:60660) 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb993e00640 1 -- 172.21.15.46:0/2381493205 learned_addr learned my addr 172.21.15.46:0/2381493205 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb99be00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb99c104b90 0x7fb99c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb993e00640 1 -- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb99c104b90 msgr2=0x7fb99c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb993e00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb99c104b90 0x7fb99c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.068+0000 7fb993e00640 1 -- 172.21.15.46:0/2381493205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c1a00a0 con 0x7fb99c10a5a0 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.069+0000 7fb993e00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c19ad00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb984006010 tx=0x7fb9840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.069+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb98403f070 con 0x7fb99c10a5a0 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.069+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9840049d0 con 0x7fb99c10a5a0 2024-09-10T23:01:37.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.069+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c1a0330 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.069+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1a0860 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.069+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb984035030 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.070+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb978001060 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.072+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fb98403b900 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb999600640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb98007a320 0x7fb98007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fb9840be220 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb99be00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb98007a320 0x7fb98007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb999600640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] conn(0x7fb9800806e0 0x7fb980082b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 --> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb98404de50 con 0x7fb9800806e0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fb9840be620 con 0x7fb99c10a5a0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.073+0000 7fb9a0e00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] conn(0x7fb9800806e0 0x7fb980082b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.074+0000 7fb99be00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb98007a320 0x7fb98007c7e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00bbe0 tx=0x7fb98c00b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.074+0000 7fb9a0e00640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] conn(0x7fb9800806e0 0x7fb980082b00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.075+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== osd.7 v2:172.21.15.73:6824/1690062257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb98404de50 con 0x7fb9800806e0 2024-09-10T23:01:37.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.089+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 --> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb978002d80 con 0x7fb9800806e0 2024-09-10T23:01:37.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.090+0000 7fb999600640 1 -- 172.21.15.46:0/2381493205 <== osd.7 v2:172.21.15.73:6824/1690062257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb978002d80 con 0x7fb9800806e0 2024-09-10T23:01:37.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.090+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] conn(0x7fb9800806e0 msgr2=0x7fb980082b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:37.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.090+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] conn(0x7fb9800806e0 0x7fb980082b00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb98007a320 msgr2=0x7fb98007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:37.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb98007a320 0x7fb98007c7e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00bbe0 tx=0x7fb98c00b390 comp rx=0 tx=0).stop 2024-09-10T23:01:37.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 msgr2=0x7fb99c19ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c19ad00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb984006010 tx=0x7fb9840045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 shutdown_connections 2024-09-10T23:01:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:6824/1690062257,v1:172.21.15.73:6825/1690062257] conn(0x7fb9800806e0 0x7fb980082b00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb98007a320 0x7fb98007c7e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb99c10a5a0 0x7fb99c19ad00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 --2- 172.21.15.46:0/2381493205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb99c104b90 0x7fb99c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:37.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 >> 172.21.15.46:0/2381493205 conn(0x7fb99c1005e0 msgr2=0x7fb99c1029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:37.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 shutdown_connections 2024-09-10T23:01:37.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.091+0000 7fb9a1800640 1 -- 172.21.15.46:0/2381493205 wait complete. 2024-09-10T23:01:38.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 -- 172.21.15.46:0/524815181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5381083a0 msgr2=0x7ff5381087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 --2- 172.21.15.46:0/524815181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5381083a0 0x7ff5381087e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff524009880 tx=0x7ff52402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 -- 172.21.15.46:0/524815181 shutdown_connections 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 --2- 172.21.15.46:0/524815181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5381083a0 0x7ff5381087e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 --2- 172.21.15.46:0/524815181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff538102990 0x7ff538102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 -- 172.21.15.46:0/524815181 >> 172.21.15.46:0/524815181 conn(0x7ff5380fe3e0 msgr2=0x7ff538100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 -- 172.21.15.46:0/524815181 shutdown_connections 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.096+0000 7ff53ee00640 1 -- 172.21.15.46:0/524815181 wait complete. 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.097+0000 7ff53ee00640 1 Processor -- start 2024-09-10T23:01:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.097+0000 7ff53ee00640 1 -- start start 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.097+0000 7ff53ee00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 0x7ff53819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.097+0000 7ff53ee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5381083a0 0x7ff53819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.097+0000 7ff53ee00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff53810f9e0 con 0x7ff538102990 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.097+0000 7ff53ee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff53810f860 con 0x7ff5381083a0 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 0x7ff53819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 0x7ff53819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60680/0 (socket says 172.21.15.46:60680) 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 -- 172.21.15.46:0/2495593038 learned_addr learned my addr 172.21.15.46:0/2495593038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53d000640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5381083a0 0x7ff53819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 -- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5381083a0 msgr2=0x7ff53819acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5381083a0 0x7ff53819acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 -- 172.21.15.46:0/2495593038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5381a0070 con 0x7ff538102990 2024-09-10T23:01:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.098+0000 7ff53da00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 0x7ff53819a790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d6f0 tx=0x7ff52c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.099+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff52c017070 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.099+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff52c00de00 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.099+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5381a0360 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.099+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff52c0049d0 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.099+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381a0940 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.100+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff538103c40 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.101+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7ff52c004c80 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.102+0000 7ff536000640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7ff52007a370 0x7ff52007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.102+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7ff52c09ca30 con 0x7ff538102990 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.102+0000 7ff53d000640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7ff52007a370 0x7ff52007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.102+0000 7ff536000640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] conn(0x7ff520080730 0x7ff520082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.102+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 --> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff52c023e50 con 0x7ff520080730 2024-09-10T23:01:38.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.102+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff52c0a12a0 con 0x7ff538102990 2024-09-10T23:01:38.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.103+0000 7ff53e400640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] conn(0x7ff520080730 0x7ff520082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:38.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.103+0000 7ff53d000640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7ff52007a370 0x7ff52007c830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff524000c00 tx=0x7ff5240058d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:38.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.103+0000 7ff53e400640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] conn(0x7ff520080730 0x7ff520082b50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:38.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.104+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== osd.6 v2:172.21.15.73:6816/2364854184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff52c023e50 con 0x7ff520080730 2024-09-10T23:01:38.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.119+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 --> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff538063860 con 0x7ff520080730 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.119+0000 7ff536000640 1 -- 172.21.15.46:0/2495593038 <== osd.6 v2:172.21.15.73:6816/2364854184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff538063860 con 0x7ff520080730 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] conn(0x7ff520080730 msgr2=0x7ff520082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] conn(0x7ff520080730 0x7ff520082b50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7ff52007a370 msgr2=0x7ff52007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7ff52007a370 0x7ff52007c830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff524000c00 tx=0x7ff5240058d0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 msgr2=0x7ff53819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 0x7ff53819a790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d6f0 tx=0x7ff52c00dbb0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 shutdown_connections 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7ff52007a370 0x7ff52007c830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:6816/2364854184,v1:172.21.15.73:6817/2364854184] conn(0x7ff520080730 0x7ff520082b50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5381083a0 0x7ff53819acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 --2- 172.21.15.46:0/2495593038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff538102990 0x7ff53819a790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:38.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 >> 172.21.15.46:0/2495593038 conn(0x7ff5380fe3e0 msgr2=0x7ff5381017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:38.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 shutdown_connections 2024-09-10T23:01:38.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:38.120+0000 7ff53ee00640 1 -- 172.21.15.46:0/2495593038 wait complete. 2024-09-10T23:01:38.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:38 smithi046 ceph-mon[28128]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:38 smithi073 ceph-mon[35473]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:39.235 INFO:teuthology.orchestra.run.smithi046.stdout:163208757268 2024-09-10T23:01:39.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 -- 172.21.15.46:0/2758594453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 msgr2=0x7fbee4102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 --2- 172.21.15.46:0/2758594453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee4102f40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009880 tx=0x7fbed802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 -- 172.21.15.46:0/2758594453 shutdown_connections 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 --2- 172.21.15.46:0/2758594453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee4108570 0x7fbee41089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 --2- 172.21.15.46:0/2758594453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee4102f40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 -- 172.21.15.46:0/2758594453 >> 172.21.15.46:0/2758594453 conn(0x7fbee40fe5b0 msgr2=0x7fbee41009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 -- 172.21.15.46:0/2758594453 shutdown_connections 2024-09-10T23:01:39.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.181+0000 7fbeebc00640 1 -- 172.21.15.46:0/2758594453 wait complete. 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.182+0000 7fbeebc00640 1 Processor -- start 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.182+0000 7fbeebc00640 1 -- start start 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbeebc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbeebc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee4108570 0x7fbee419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbeebc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbee410fb90 con 0x7fbee4102b60 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbeebc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbee410fa10 con 0x7fbee4108570 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60674/0 (socket says 172.21.15.46:60674) 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee9200640 1 -- 172.21.15.46:0/901199818 learned_addr learned my addr 172.21.15.46:0/901199818 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee3e00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee4108570 0x7fbee419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee9200640 1 -- 172.21.15.46:0/901199818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee4108570 msgr2=0x7fbee419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee9200640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee4108570 0x7fbee419af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.183+0000 7fbee9200640 1 -- 172.21.15.46:0/901199818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee41a02c0 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.184+0000 7fbee9200640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee419a9e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbed8006010 tx=0x7fbed80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.184+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed803f070 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.184+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed80048d0 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.184+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed8035030 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.184+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee41a0550 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.184+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee41a0a80 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.185+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbee41a1040 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.186+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fbed80035f0 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.187+0000 7fbee1600640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbecc07a320 0x7fbecc07c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.187+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fbed80bdbc0 con 0x7fbee4102b60 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.187+0000 7fbee3e00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbecc07a320 0x7fbecc07c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.188+0000 7fbee1600640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] conn(0x7fbecc0806e0 0x7fbecc082b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.188+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 --> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbed8004b70 con 0x7fbecc0806e0 2024-09-10T23:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.188+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fbed80c22a0 con 0x7fbee4102b60 2024-09-10T23:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.188+0000 7fbee9c00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] conn(0x7fbecc0806e0 0x7fbecc082b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.188+0000 7fbee3e00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbecc07a320 0x7fbecc07c7e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbee41081c0 tx=0x7fbed0005f90 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.188+0000 7fbee9c00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] conn(0x7fbecc0806e0 0x7fbecc082b00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:39.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.189+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== osd.2 v2:172.21.15.46:6818/3774780724 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbed8004b70 con 0x7fbecc0806e0 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.203+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 --> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbee40ff8a0 con 0x7fbecc0806e0 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbee1600640 1 -- 172.21.15.46:0/901199818 <== osd.2 v2:172.21.15.46:6818/3774780724 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbee40ff8a0 con 0x7fbecc0806e0 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] conn(0x7fbecc0806e0 msgr2=0x7fbecc082b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] conn(0x7fbecc0806e0 0x7fbecc082b00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbecc07a320 msgr2=0x7fbecc07c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbecc07a320 0x7fbecc07c7e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbee41081c0 tx=0x7fbed0005f90 comp rx=0 tx=0).stop 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 msgr2=0x7fbee419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee419a9e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbed8006010 tx=0x7fbed80045c0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 shutdown_connections 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6818/3774780724,v1:172.21.15.46:6819/3774780724] conn(0x7fbecc0806e0 0x7fbecc082b00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbecc07a320 0x7fbecc07c7e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee4108570 0x7fbee419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.204+0000 7fbeebc00640 1 --2- 172.21.15.46:0/901199818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbee4102b60 0x7fbee419a9e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.205+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 >> 172.21.15.46:0/901199818 conn(0x7fbee40fe5b0 msgr2=0x7fbee40fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:39.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.205+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 shutdown_connections 2024-09-10T23:01:39.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:37.205+0000 7fbeebc00640 1 -- 172.21.15.46:0/901199818 wait complete. 2024-09-10T23:01:39.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.666+0000 7f86e1600640 1 -- 172.21.15.46:0/1150201655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 msgr2=0x7f86dc077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.666+0000 7f86e1600640 1 --2- 172.21.15.46:0/1150201655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc077ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009c50 tx=0x7f86cc02a9a0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.667+0000 7f86e1600640 1 -- 172.21.15.46:0/1150201655 shutdown_connections 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.667+0000 7f86e1600640 1 --2- 172.21.15.46:0/1150201655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc077ff0 0x7f86dc1131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.667+0000 7f86e1600640 1 --2- 172.21.15.46:0/1150201655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc077ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.667+0000 7f86e1600640 1 -- 172.21.15.46:0/1150201655 >> 172.21.15.46:0/1150201655 conn(0x7f86dc100780 msgr2=0x7f86dc102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.667+0000 7f86e1600640 1 -- 172.21.15.46:0/1150201655 shutdown_connections 2024-09-10T23:01:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.667+0000 7f86e1600640 1 -- 172.21.15.46:0/1150201655 wait complete. 2024-09-10T23:01:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86e1600640 1 Processor -- start 2024-09-10T23:01:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86e1600640 1 -- start start 2024-09-10T23:01:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86e1600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86e1600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc077ff0 0x7f86dc19f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86e1600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc116100 con 0x7f86dc0776d0 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86e1600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc115f80 con 0x7f86dc077ff0 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86daa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86daa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc19ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60690/0 (socket says 172.21.15.46:60690) 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86daa00640 1 -- 172.21.15.46:0/1297777654 learned_addr learned my addr 172.21.15.46:0/1297777654 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.668+0000 7f86d2000640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc077ff0 0x7f86dc19f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86daa00640 1 -- 172.21.15.46:0/1297777654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc077ff0 msgr2=0x7f86dc19f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86daa00640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc077ff0 0x7f86dc19f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86daa00640 1 -- 172.21.15.46:0/1297777654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc1a45c0 con 0x7f86dc0776d0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86daa00640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc19ece0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86cc005e30 tx=0x7f86cc02f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86cc034030 con 0x7f86dc0776d0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86cc02fdc0 con 0x7f86dc0776d0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86cc0043b0 con 0x7f86dc0776d0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.669+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc1a48b0 con 0x7f86dc0776d0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.670+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc1a4ec0 con 0x7f86dc0776d0 2024-09-10T23:01:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.670+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86dc078be0 con 0x7f86dc0776d0 2024-09-10T23:01:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.672+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f86cc041070 con 0x7f86dc0776d0 2024-09-10T23:01:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.673+0000 7f86d3e00640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f86c007a320 0x7f86c007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.673+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f86cc0bdd10 con 0x7f86dc0776d0 2024-09-10T23:01:39.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.673+0000 7f86d2000640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f86c007a320 0x7f86c007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.673+0000 7f86d3e00640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] conn(0x7f86c00806e0 0x7f86c0082b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:39.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.673+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 --> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86cc038e50 con 0x7f86c00806e0 2024-09-10T23:01:39.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.673+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f86cc0c0380 con 0x7f86dc0776d0 2024-09-10T23:01:39.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.674+0000 7f86db400640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] conn(0x7f86c00806e0 0x7f86c0082b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.674+0000 7f86d2000640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f86c007a320 0x7f86c007c7e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86dc102e70 tx=0x7f86c400b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.674+0000 7f86db400640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] conn(0x7f86c00806e0 0x7f86c0082b00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.675+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== osd.0 v2:172.21.15.46:6802/2885579696 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86cc038e50 con 0x7f86c00806e0 2024-09-10T23:01:39.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.689+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 --> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86dc063810 con 0x7f86c00806e0 2024-09-10T23:01:39.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.689+0000 7f86d3e00640 1 -- 172.21.15.46:0/1297777654 <== osd.0 v2:172.21.15.46:6802/2885579696 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f86dc063810 con 0x7f86c00806e0 2024-09-10T23:01:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] conn(0x7f86c00806e0 msgr2=0x7f86c0082b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] conn(0x7f86c00806e0 0x7f86c0082b00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f86c007a320 msgr2=0x7f86c007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f86c007a320 0x7f86c007c7e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86dc102e70 tx=0x7f86c400b390 comp rx=0 tx=0).stop 2024-09-10T23:01:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 msgr2=0x7f86dc19ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc19ece0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86cc005e30 tx=0x7f86cc02f9c0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 shutdown_connections 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6802/2885579696,v1:172.21.15.46:6803/2885579696] conn(0x7f86c00806e0 0x7f86c0082b00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f86c007a320 0x7f86c007c7e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc077ff0 0x7f86dc19f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 --2- 172.21.15.46:0/1297777654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86dc0776d0 0x7f86dc19ece0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 >> 172.21.15.46:0/1297777654 conn(0x7f86dc100780 msgr2=0x7f86dc101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 shutdown_connections 2024-09-10T23:01:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:39.690+0000 7f86e1600640 1 -- 172.21.15.46:0/1297777654 wait complete. 2024-09-10T23:01:39.812 INFO:teuthology.orchestra.run.smithi046.stdout:133143986202 2024-09-10T23:01:39.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T23:01:40.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:40 smithi046 ceph-mon[28128]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:40.241 INFO:teuthology.orchestra.run.smithi046.stdout:188978561038 2024-09-10T23:01:40.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T23:01:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:40 smithi073 ceph-mon[35473]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:40.797 INFO:teuthology.orchestra.run.smithi046.stdout:111669149729 2024-09-10T23:01:40.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T23:01:41.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 -- 172.21.15.46:0/1697644986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 msgr2=0x7f1c8010ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:41.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 --2- 172.21.15.46:0/1697644986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8010ab80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009880 tx=0x7f1c6c02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 -- 172.21.15.46:0/1697644986 shutdown_connections 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 --2- 172.21.15.46:0/1697644986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8010ab80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 --2- 172.21.15.46:0/1697644986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c80104d30 0x7f1c80105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 -- 172.21.15.46:0/1697644986 >> 172.21.15.46:0/1697644986 conn(0x7f1c80100780 msgr2=0x7f1c80102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.099+0000 7f1c87000640 1 -- 172.21.15.46:0/1697644986 shutdown_connections 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.100+0000 7f1c87000640 1 -- 172.21.15.46:0/1697644986 wait complete. 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.101+0000 7f1c87000640 1 Processor -- start 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.101+0000 7f1c87000640 1 -- start start 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.101+0000 7f1c87000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c80104d30 0x7f1c8019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.101+0000 7f1c87000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.101+0000 7f1c87000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80111d60 con 0x7f1c8010a740 2024-09-10T23:01:41.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.101+0000 7f1c87000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80111be0 con 0x7f1c80104d30 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8019ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60714/0 (socket says 172.21.15.46:60714) 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 -- 172.21.15.46:0/183997989 learned_addr learned my addr 172.21.15.46:0/183997989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7fe00640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c80104d30 0x7f1c8019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 -- 172.21.15.46:0/183997989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c80104d30 msgr2=0x7f1c8019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c80104d30 0x7f1c8019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 -- 172.21.15.46:0/183997989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c801a0220 con 0x7f1c8010a740 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.102+0000 7f1c7f400640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8019ae80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006010 tx=0x7f1c6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.103+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c03f070 con 0x7f1c8010a740 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.103+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c6c0049d0 con 0x7f1c8010a740 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.103+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c801a04b0 con 0x7f1c8010a740 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.103+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c035030 con 0x7f1c8010a740 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.103+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c801a0a60 con 0x7f1c8010a740 2024-09-10T23:01:41.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.104+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c801a1020 con 0x7f1c8010a740 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.105+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f1c6c0035f0 con 0x7f1c8010a740 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c7cc00640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f1c6407a370 0x7f1c6407c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f1c6c0bdbf0 con 0x7f1c8010a740 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c7fe00640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f1c6407a370 0x7f1c6407c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c7cc00640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] conn(0x7f1c64080730 0x7f1c64082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 --> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c6c031e50 con 0x7f1c64080730 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f1c6c0c22a0 con 0x7f1c8010a740 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.106+0000 7f1c85000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] conn(0x7f1c64080730 0x7f1c64082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.107+0000 7f1c7fe00640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f1c6407a370 0x7f1c6407c830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000bbe0 tx=0x7f1c7000b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.107+0000 7f1c85000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] conn(0x7f1c64080730 0x7f1c64082b50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.108+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== osd.1 v2:172.21.15.46:6810/3611441892 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c6c031e50 con 0x7f1c64080730 2024-09-10T23:01:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.122+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 --> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c80063810 con 0x7f1c64080730 2024-09-10T23:01:41.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c7cc00640 1 -- 172.21.15.46:0/183997989 <== osd.1 v2:172.21.15.46:6810/3611441892 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c80063810 con 0x7f1c64080730 2024-09-10T23:01:41.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] conn(0x7f1c64080730 msgr2=0x7f1c64082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:41.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] conn(0x7f1c64080730 0x7f1c64082b50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f1c6407a370 msgr2=0x7f1c6407c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:41.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f1c6407a370 0x7f1c6407c830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000bbe0 tx=0x7f1c7000b390 comp rx=0 tx=0).stop 2024-09-10T23:01:41.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 msgr2=0x7f1c8019ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8019ae80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006010 tx=0x7f1c6c0045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 shutdown_connections 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6810/3611441892,v1:172.21.15.46:6811/3611441892] conn(0x7f1c64080730 0x7f1c64082b50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f1c6407a370 0x7f1c6407c830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c8010a740 0x7f1c8019ae80 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006010 tx=0x7f1c6c0045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 --2- 172.21.15.46:0/183997989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c80104d30 0x7f1c8019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.123+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 >> 172.21.15.46:0/183997989 conn(0x7f1c80100780 msgr2=0x7f1c80102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.124+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 shutdown_connections 2024-09-10T23:01:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:41.124+0000 7f1c87000640 1 -- 172.21.15.46:0/183997989 wait complete. 2024-09-10T23:01:41.883 INFO:teuthology.orchestra.run.smithi046.stdout:38654705718 2024-09-10T23:01:41.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T23:01:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:42 smithi046 ceph-mon[28128]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:42.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:42 smithi073 ceph-mon[35473]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:42.393 INFO:teuthology.orchestra.run.smithi046.stdout:60129542191 2024-09-10T23:01:42.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T23:01:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:214748364807 2024-09-10T23:01:42.885 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T23:01:43.421 INFO:teuthology.orchestra.run.smithi046.stdout:81604378662 2024-09-10T23:01:43.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T23:01:43.509 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:43.523 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:43.523 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:43.527 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:43.534 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:43.536 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:44.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:44 smithi046 ceph-mon[28128]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:44.332 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:44 smithi073 ceph-mon[35473]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.854+0000 7fc1d7800640 1 -- 172.21.15.46:0/4201390246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d010a740 msgr2=0x7fc1d010ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.854+0000 7fc1d7800640 1 --2- 172.21.15.46:0/4201390246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d010a740 0x7fc1d010ab80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009880 tx=0x7fc1b802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.854+0000 7fc1d7800640 1 -- 172.21.15.46:0/4201390246 shutdown_connections 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.854+0000 7fc1d7800640 1 --2- 172.21.15.46:0/4201390246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d010a740 0x7fc1d010ab80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.854+0000 7fc1d7800640 1 --2- 172.21.15.46:0/4201390246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1d0104d30 0x7fc1d0105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.854+0000 7fc1d7800640 1 -- 172.21.15.46:0/4201390246 >> 172.21.15.46:0/4201390246 conn(0x7fc1d0100780 msgr2=0x7fc1d0102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.855+0000 7fc1d7800640 1 -- 172.21.15.46:0/4201390246 shutdown_connections 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.855+0000 7fc1d7800640 1 -- 172.21.15.46:0/4201390246 wait complete. 2024-09-10T23:01:44.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.855+0000 7fc1d7800640 1 Processor -- start 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d7800640 1 -- start start 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d7800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 0x7fc1d019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d7800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1d010a740 0x7fc1d019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d7800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d0111d80 con 0x7fc1d0104d30 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d7800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d0111c00 con 0x7fc1d010a740 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 0x7fc1d019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 0x7fc1d019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38250/0 (socket says 172.21.15.46:38250) 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d4e00640 1 -- 172.21.15.46:0/1016787603 learned_addr learned my addr 172.21.15.46:0/1016787603 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d4e00640 1 -- 172.21.15.46:0/1016787603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1d010a740 msgr2=0x7fc1d019ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d4e00640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1d010a740 0x7fc1d019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.856+0000 7fc1d4e00640 1 -- 172.21.15.46:0/1016787603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d01a0220 con 0x7fc1d0104d30 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.857+0000 7fc1d4e00640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 0x7fc1d019a940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000d6f0 tx=0x7fc1c000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.857+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1c0017070 con 0x7fc1d0104d30 2024-09-10T23:01:44.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.857+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1c000de00 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.857+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d01a0510 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.857+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1c00049d0 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.857+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d01a0b20 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.858+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d019b600 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.859+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fc1c0004cd0 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.860+0000 7fc1ce000640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1b407a320 0x7fc1b407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.860+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fc1c009cbe0 con 0x7fc1d0104d30 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.861+0000 7fc1c7e00640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1b407a320 0x7fc1b407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.861+0000 7fc1c7e00640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1b407a320 0x7fc1b407c7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1b802a9c0 tx=0x7fc1b8000bc0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.865+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc1d019b600 con 0x7fc1d0104d30 2024-09-10T23:01:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.070+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc1d010cee0 con 0x7fc1d0104d30 2024-09-10T23:01:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.070+0000 7fc1ce000640 1 -- 172.21.15.46:0/1016787603 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc1c0064590 con 0x7fc1d0104d30 2024-09-10T23:01:45.072 INFO:teuthology.orchestra.run.smithi046.stdout:111669149731 2024-09-10T23:01:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1b407a320 msgr2=0x7fc1b407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1b407a320 0x7fc1b407c7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1b802a9c0 tx=0x7fc1b8000bc0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 msgr2=0x7fc1d019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 0x7fc1d019a940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000d6f0 tx=0x7fc1c000dbb0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 shutdown_connections 2024-09-10T23:01:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc1b407a320 0x7fc1b407c7e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1d010a740 0x7fc1d019ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 --2- 172.21.15.46:0/1016787603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d0104d30 0x7fc1d019a940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 >> 172.21.15.46:0/1016787603 conn(0x7fc1d0100780 msgr2=0x7fc1d0102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 shutdown_connections 2024-09-10T23:01:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.073+0000 7fc1d7800640 1 -- 172.21.15.46:0/1016787603 wait complete. 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.985+0000 7fabc8000640 1 -- 172.21.15.46:0/1576379597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc010a740 msgr2=0x7fabc010ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.985+0000 7fabc8000640 1 --2- 172.21.15.46:0/1576379597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc010a740 0x7fabc010ab80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabac009880 tx=0x7fabac02a4b0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.986+0000 7fabc8000640 1 -- 172.21.15.46:0/1576379597 shutdown_connections 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.986+0000 7fabc8000640 1 --2- 172.21.15.46:0/1576379597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc010a740 0x7fabc010ab80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.986+0000 7fabc8000640 1 --2- 172.21.15.46:0/1576379597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0104d30 0x7fabc0105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.986+0000 7fabc8000640 1 -- 172.21.15.46:0/1576379597 >> 172.21.15.46:0/1576379597 conn(0x7fabc0100780 msgr2=0x7fabc0102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.986+0000 7fabc8000640 1 -- 172.21.15.46:0/1576379597 shutdown_connections 2024-09-10T23:01:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.986+0000 7fabc8000640 1 -- 172.21.15.46:0/1576379597 wait complete. 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc8000640 1 Processor -- start 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc8000640 1 -- start start 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc8000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 0x7fabc019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc8000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc010a740 0x7fabc019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc8000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0111d60 con 0x7fabc0104d30 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc8000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0111be0 con 0x7fabc010a740 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 0x7fabc019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 0x7fabc019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38276/0 (socket says 172.21.15.46:38276) 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.987+0000 7fabc5600640 1 -- 172.21.15.46:0/1176514635 learned_addr learned my addr 172.21.15.46:0/1176514635 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabc4c00640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc010a740 0x7fabc019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabc5600640 1 -- 172.21.15.46:0/1176514635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc010a740 msgr2=0x7fabc019ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabc5600640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc010a740 0x7fabc019ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabc5600640 1 -- 172.21.15.46:0/1176514635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc01a0220 con 0x7fabc0104d30 2024-09-10T23:01:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabc5600640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 0x7fabc019a940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabb400d8d0 tx=0x7fabb400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabb4017070 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabb4010460 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc01a0510 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.988+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabb400f5f0 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.989+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc01a0b20 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.990+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc019b600 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.991+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fabb4010930 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.992+0000 7fabbe000640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faba807a320 0x7faba807c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.992+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fabb409cd70 con 0x7fabc0104d30 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.992+0000 7fabc4c00640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faba807a320 0x7faba807c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.993+0000 7fabc4c00640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faba807a320 0x7faba807c7e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fabc01094c0 tx=0x7fabac0095f0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:44.996+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fabc019b600 con 0x7fabc0104d30 2024-09-10T23:01:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.197+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fabc0105fe0 con 0x7fabc0104d30 2024-09-10T23:01:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.197+0000 7fabbe000640 1 -- 172.21.15.46:0/1176514635 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fabb4064720 con 0x7fabc0104d30 2024-09-10T23:01:45.199 INFO:teuthology.orchestra.run.smithi046.stdout:163208757270 2024-09-10T23:01:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faba807a320 msgr2=0x7faba807c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faba807a320 0x7faba807c7e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fabc01094c0 tx=0x7fabac0095f0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 msgr2=0x7fabc019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 0x7fabc019a940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabb400d8d0 tx=0x7fabb400dd90 comp rx=0 tx=0).stop 2024-09-10T23:01:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 shutdown_connections 2024-09-10T23:01:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faba807a320 0x7faba807c7e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc010a740 0x7fabc019ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 --2- 172.21.15.46:0/1176514635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc0104d30 0x7fabc019a940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 >> 172.21.15.46:0/1176514635 conn(0x7fabc0100780 msgr2=0x7fabc0102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 shutdown_connections 2024-09-10T23:01:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:45.200+0000 7fabc8000640 1 -- 172.21.15.46:0/1176514635 wait complete. 2024-09-10T23:01:46.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:46 smithi073 ceph-mon[35473]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:46.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:46 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1016787603' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:01:46.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:46 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1176514635' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:01:46.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:46 smithi046 ceph-mon[28128]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:46.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:46 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1016787603' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:01:46.205 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:46 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1176514635' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:01:46.550 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757268 got 163208757270 for osd.5 2024-09-10T23:01:46.550 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 -- 172.21.15.46:0/2352400162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 msgr2=0x7fc594105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 --2- 172.21.15.46:0/2352400162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc594105110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc584009880 tx=0x7fc58402a4b0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 -- 172.21.15.46:0/2352400162 shutdown_connections 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 --2- 172.21.15.46:0/2352400162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59410a740 0x7fc59410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 --2- 172.21.15.46:0/2352400162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc594105110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 -- 172.21.15.46:0/2352400162 >> 172.21.15.46:0/2352400162 conn(0x7fc594100780 msgr2=0x7fc594102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 -- 172.21.15.46:0/2352400162 shutdown_connections 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.202+0000 7fc599c00640 1 -- 172.21.15.46:0/2352400162 wait complete. 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.203+0000 7fc599c00640 1 Processor -- start 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.203+0000 7fc599c00640 1 -- start start 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc599c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc59419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc599c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59410a740 0x7fc59419ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc599c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc594111d80 con 0x7fc594104d30 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc599c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc594111c00 con 0x7fc59410a740 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc59419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc59419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38286/0 (socket says 172.21.15.46:38286) 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592a00640 1 -- 172.21.15.46:0/1730928572 learned_addr learned my addr 172.21.15.46:0/1730928572 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592000640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59410a740 0x7fc59419ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592a00640 1 -- 172.21.15.46:0/1730928572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59410a740 msgr2=0x7fc59419ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592a00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59410a740 0x7fc59419ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.204+0000 7fc592a00640 1 -- 172.21.15.46:0/1730928572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5941a0590 con 0x7fc594104d30 2024-09-10T23:01:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.205+0000 7fc592a00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc59419f9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc584006010 tx=0x7fc5840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.205+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc58403f070 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.205+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5840049d0 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.205+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5941a0820 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.205+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc584035030 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.205+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5941a8e40 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.206+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc594105fe0 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.207+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fc5840035f0 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.208+0000 7fc58b400640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc57807a370 0x7fc57807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.208+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fc5840bdbf0 con 0x7fc594104d30 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.208+0000 7fc592000640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc57807a370 0x7fc57807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.209+0000 7fc592000640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc57807a370 0x7fc57807c830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc59407b600 tx=0x7fc58000b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.212+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc5941a0820 con 0x7fc594104d30 2024-09-10T23:01:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.412+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc594105110 con 0x7fc594104d30 2024-09-10T23:01:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.413+0000 7fc58b400640 1 -- 172.21.15.46:0/1730928572 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc584089a00 con 0x7fc594104d30 2024-09-10T23:01:46.622 INFO:teuthology.orchestra.run.smithi046.stdout:60129542191 2024-09-10T23:01:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc57807a370 msgr2=0x7fc57807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc57807a370 0x7fc57807c830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc59407b600 tx=0x7fc58000b390 comp rx=0 tx=0).stop 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 msgr2=0x7fc59419f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc59419f9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc584006010 tx=0x7fc5840045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 shutdown_connections 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc57807a370 0x7fc57807c830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59410a740 0x7fc59419ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 --2- 172.21.15.46:0/1730928572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc594104d30 0x7fc59419f9f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 >> 172.21.15.46:0/1730928572 conn(0x7fc594100780 msgr2=0x7fc594102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 shutdown_connections 2024-09-10T23:01:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:46.415+0000 7fc599c00640 1 -- 172.21.15.46:0/1730928572 wait complete. 2024-09-10T23:01:47.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:47.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:47 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1730928572' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:01:47.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:01:47.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:47 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1730928572' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:01:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.469+0000 7f8dfac00640 1 -- 172.21.15.46:0/3799221184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 msgr2=0x7f8df4105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.469+0000 7f8dfac00640 1 --2- 172.21.15.46:0/3799221184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df4105110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009880 tx=0x7f8de402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.469+0000 7f8dfac00640 1 -- 172.21.15.46:0/3799221184 shutdown_connections 2024-09-10T23:01:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.469+0000 7f8dfac00640 1 --2- 172.21.15.46:0/3799221184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 0x7f8df410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.469+0000 7f8dfac00640 1 --2- 172.21.15.46:0/3799221184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df4105110 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.469+0000 7f8dfac00640 1 -- 172.21.15.46:0/3799221184 >> 172.21.15.46:0/3799221184 conn(0x7f8df4100780 msgr2=0x7f8df4102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.470+0000 7f8dfac00640 1 -- 172.21.15.46:0/3799221184 shutdown_connections 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.470+0000 7f8dfac00640 1 -- 172.21.15.46:0/3799221184 wait complete. 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.471+0000 7f8dfac00640 1 Processor -- start 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.471+0000 7f8dfac00640 1 -- start start 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.471+0000 7f8dfac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.471+0000 7f8dfac00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 0x7f8df419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.471+0000 7f8dfac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8df4111d60 con 0x7f8df4104d30 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.471+0000 7f8dfac00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8df4111be0 con 0x7f8df410a740 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8df3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8df3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38304/0 (socket says 172.21.15.46:38304) 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8df3e00640 1 -- 172.21.15.46:0/1582331380 learned_addr learned my addr 172.21.15.46:0/1582331380 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8debe00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 0x7f8df419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:47.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8df3e00640 1 -- 172.21.15.46:0/1582331380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 msgr2=0x7f8df419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:47.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8df3e00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 0x7f8df419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8df3e00640 1 -- 172.21.15.46:0/1582331380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df41a0280 con 0x7f8df4104d30 2024-09-10T23:01:47.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.472+0000 7f8debe00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 0x7f8df419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.473+0000 7f8df3e00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df419a9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8de4006010 tx=0x7f8de40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.473+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8de403f070 con 0x7f8df4104d30 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.473+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8de4004a50 con 0x7f8df4104d30 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.473+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df41a0510 con 0x7f8df4104d30 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.473+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8de4035030 con 0x7f8df4104d30 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.473+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df41a0a40 con 0x7f8df4104d30 2024-09-10T23:01:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.475+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df419b660 con 0x7f8df4104d30 2024-09-10T23:01:47.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.476+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f8de4003b80 con 0x7f8df4104d30 2024-09-10T23:01:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.477+0000 7f8df1600640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8dd807a370 0x7f8dd807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.477+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f8de40bdc30 con 0x7f8df4104d30 2024-09-10T23:01:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.478+0000 7f8debe00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8dd807a370 0x7f8dd807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.478+0000 7f8debe00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8dd807a370 0x7f8dd807c830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8df410a390 tx=0x7f8ddc00a2d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.481+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8df419b660 con 0x7f8df4104d30 2024-09-10T23:01:47.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.698+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8df419bad0 con 0x7f8df4104d30 2024-09-10T23:01:47.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.699+0000 7f8df1600640 1 -- 172.21.15.46:0/1582331380 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8de4085660 con 0x7f8df4104d30 2024-09-10T23:01:47.701 INFO:teuthology.orchestra.run.smithi046.stdout:38654705720 2024-09-10T23:01:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.701+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8dd807a370 msgr2=0x7f8dd807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.701+0000 7f8dfac00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8dd807a370 0x7f8dd807c830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8df410a390 tx=0x7f8ddc00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.701+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 msgr2=0x7f8df419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.701+0000 7f8dfac00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df419a9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8de4006010 tx=0x7f8de40045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 shutdown_connections 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f8dd807a370 0x7f8dd807c830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8df410a740 0x7f8df419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 --2- 172.21.15.46:0/1582331380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8df4104d30 0x7f8df419a9a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 >> 172.21.15.46:0/1582331380 conn(0x7f8df4100780 msgr2=0x7f8df41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 shutdown_connections 2024-09-10T23:01:47.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:47.702+0000 7f8dfac00640 1 -- 172.21.15.46:0/1582331380 wait complete. 2024-09-10T23:01:48.026 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542191 got 60129542191 for osd.1 2024-09-10T23:01:48.026 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:48.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:48 smithi046 ceph-mon[28128]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:48.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:48 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1582331380' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:01:48.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:48 smithi073 ceph-mon[35473]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:48.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:48 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1582331380' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:01:48.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 -- 172.21.15.46:0/2691870767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a700754e0 msgr2=0x7f9a700758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:48.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 --2- 172.21.15.46:0/2691870767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a700754e0 0x7f9a700758c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009880 tx=0x7f9a6002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 -- 172.21.15.46:0/2691870767 shutdown_connections 2024-09-10T23:01:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 --2- 172.21.15.46:0/2691870767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a70075e00 0x7f9a7010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 --2- 172.21.15.46:0/2691870767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a700754e0 0x7f9a700758c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 -- 172.21.15.46:0/2691870767 >> 172.21.15.46:0/2691870767 conn(0x7f9a700fe3e0 msgr2=0x7f9a70100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 -- 172.21.15.46:0/2691870767 shutdown_connections 2024-09-10T23:01:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.357+0000 7f9a6f200640 1 -- 172.21.15.46:0/2691870767 wait complete. 2024-09-10T23:01:48.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.358+0000 7f9a6f200640 1 Processor -- start 2024-09-10T23:01:48.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.358+0000 7f9a6f200640 1 -- start start 2024-09-10T23:01:48.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.358+0000 7f9a6f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700754e0 0x7f9a7019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:48.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.358+0000 7f9a6f200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 0x7f9a7019ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6f200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70111bc0 con 0x7f9a70075e00 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70111a40 con 0x7f9a700754e0 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 0x7f9a7019ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 0x7f9a7019ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38334/0 (socket says 172.21.15.46:38334) 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6d400640 1 -- 172.21.15.46:0/1969648302 learned_addr learned my addr 172.21.15.46:0/1969648302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6de00640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700754e0 0x7f9a7019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6d400640 1 -- 172.21.15.46:0/1969648302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700754e0 msgr2=0x7f9a7019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6d400640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700754e0 0x7f9a7019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.359+0000 7f9a6d400640 1 -- 172.21.15.46:0/1969648302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a701a00c0 con 0x7f9a70075e00 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.360+0000 7f9a6d400640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 0x7f9a7019ad20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00e970 tx=0x7f9a5c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.360+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a5c00cac0 con 0x7f9a70075e00 2024-09-10T23:01:48.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.360+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a5c0054b0 con 0x7f9a70075e00 2024-09-10T23:01:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.360+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a701a03b0 con 0x7f9a70075e00 2024-09-10T23:01:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.360+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a5c004c40 con 0x7f9a70075e00 2024-09-10T23:01:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.360+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a701a0940 con 0x7f9a70075e00 2024-09-10T23:01:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.362+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7019b4a0 con 0x7f9a70075e00 2024-09-10T23:01:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.364+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f9a5c00cc60 con 0x7f9a70075e00 2024-09-10T23:01:48.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.366+0000 7f9a66a00640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9a5407a320 0x7f9a5407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:48.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.366+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f9a5c09d420 con 0x7f9a70075e00 2024-09-10T23:01:48.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.366+0000 7f9a6de00640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9a5407a320 0x7f9a5407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:48.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.367+0000 7f9a6de00640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9a5407a320 0x7f9a5407c7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a60000c00 tx=0x7f9a60005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:48.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.371+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a7019b4a0 con 0x7f9a70075e00 2024-09-10T23:01:48.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.572+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9a7010c040 con 0x7f9a70075e00 2024-09-10T23:01:48.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.572+0000 7f9a66a00640 1 -- 172.21.15.46:0/1969648302 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9a5c064e70 con 0x7f9a70075e00 2024-09-10T23:01:48.574 INFO:teuthology.orchestra.run.smithi046.stdout:214748364809 2024-09-10T23:01:48.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.574+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9a5407a320 msgr2=0x7f9a5407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:48.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.574+0000 7f9a6f200640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9a5407a320 0x7f9a5407c7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a60000c00 tx=0x7f9a60005a20 comp rx=0 tx=0).stop 2024-09-10T23:01:48.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.574+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 msgr2=0x7f9a7019ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.574+0000 7f9a6f200640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 0x7f9a7019ad20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00e970 tx=0x7f9a5c00ed70 comp rx=0 tx=0).stop 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 shutdown_connections 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9a5407a320 0x7f9a5407c7e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a70075e00 0x7f9a7019ad20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 --2- 172.21.15.46:0/1969648302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700754e0 0x7f9a7019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 >> 172.21.15.46:0/1969648302 conn(0x7f9a700fe3e0 msgr2=0x7f9a70109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 shutdown_connections 2024-09-10T23:01:48.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:48.575+0000 7f9a6f200640 1 -- 172.21.15.46:0/1969648302 wait complete. 2024-09-10T23:01:48.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149729 got 111669149731 for osd.3 2024-09-10T23:01:48.969 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:49.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.154+0000 7fe0f3a00640 1 -- 172.21.15.46:0/1263777839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 msgr2=0x7fe0ec102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:49.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.154+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/1263777839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec102f40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009880 tx=0x7fe0dc02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.154+0000 7fe0f3a00640 1 -- 172.21.15.46:0/1263777839 shutdown_connections 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.154+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/1263777839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ec108570 0x7fe0ec1089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.154+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/1263777839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec102f40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.154+0000 7fe0f3a00640 1 -- 172.21.15.46:0/1263777839 >> 172.21.15.46:0/1263777839 conn(0x7fe0ec0fe5b0 msgr2=0x7fe0ec1009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.155+0000 7fe0f3a00640 1 -- 172.21.15.46:0/1263777839 shutdown_connections 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.155+0000 7fe0f3a00640 1 -- 172.21.15.46:0/1263777839 wait complete. 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.156+0000 7fe0f3a00640 1 Processor -- start 2024-09-10T23:01:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.156+0000 7fe0f3a00640 1 -- start start 2024-09-10T23:01:49.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.156+0000 7fe0f3a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:49.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.156+0000 7fe0f3a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ec108570 0x7fe0ec19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:49.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.156+0000 7fe0f3a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10fb90 con 0x7fe0ec102b60 2024-09-10T23:01:49.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.156+0000 7fe0f3a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10fa10 con 0x7fe0ec108570 2024-09-10T23:01:49.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0f1000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:49.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0f1000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38352/0 (socket says 172.21.15.46:38352) 2024-09-10T23:01:49.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0f1000640 1 -- 172.21.15.46:0/3049619910 learned_addr learned my addr 172.21.15.46:0/3049619910 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:49.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0e3e00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ec108570 0x7fe0ec19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0f1000640 1 -- 172.21.15.46:0/3049619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ec108570 msgr2=0x7fe0ec19aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0f1000640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ec108570 0x7fe0ec19aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.157+0000 7fe0f1000640 1 -- 172.21.15.46:0/3049619910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec1a0240 con 0x7fe0ec102b60 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.158+0000 7fe0f1000640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec19a960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.158+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0dc03f070 con 0x7fe0ec102b60 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.158+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0dc0049d0 con 0x7fe0ec102b60 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.158+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec1a04d0 con 0x7fe0ec102b60 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.158+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0dc035030 con 0x7fe0ec102b60 2024-09-10T23:01:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.158+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a0a80 con 0x7fe0ec102b60 2024-09-10T23:01:49.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.160+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec19b620 con 0x7fe0ec102b60 2024-09-10T23:01:49.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.160+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fe0dc0035f0 con 0x7fe0ec102b60 2024-09-10T23:01:49.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.162+0000 7fe0ea000640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe0d007a370 0x7fe0d007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:49.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.162+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fe0dc0bdbf0 con 0x7fe0ec102b60 2024-09-10T23:01:49.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.162+0000 7fe0e3e00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe0d007a370 0x7fe0d007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:49.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.163+0000 7fe0e3e00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe0d007a370 0x7fe0d007c830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec077510 tx=0x7fe0d400b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:49.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.166+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe0ec19b620 con 0x7fe0ec102b60 2024-09-10T23:01:49.221 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:49 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1969648302' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:01:49.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:49 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1969648302' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:01:49.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.364+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe0ec1a0d30 con 0x7fe0ec102b60 2024-09-10T23:01:49.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.364+0000 7fe0ea000640 1 -- 172.21.15.46:0/3049619910 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe0dc089a00 con 0x7fe0ec102b60 2024-09-10T23:01:49.366 INFO:teuthology.orchestra.run.smithi046.stdout:188978561040 2024-09-10T23:01:49.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.366+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe0d007a370 msgr2=0x7fe0d007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.366+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe0d007a370 0x7fe0d007c830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec077510 tx=0x7fe0d400b390 comp rx=0 tx=0).stop 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.366+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 msgr2=0x7fe0ec19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.366+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec19a960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc0045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 shutdown_connections 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe0d007a370 0x7fe0d007c830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ec108570 0x7fe0ec19aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 --2- 172.21.15.46:0/3049619910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0ec102b60 0x7fe0ec19a960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 >> 172.21.15.46:0/3049619910 conn(0x7fe0ec0fe5b0 msgr2=0x7fe0ec0753b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 shutdown_connections 2024-09-10T23:01:49.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:49.367+0000 7fe0f3a00640 1 -- 172.21.15.46:0/3049619910 wait complete. 2024-09-10T23:01:50.256 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364807 got 214748364809 for osd.7 2024-09-10T23:01:50.256 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:50.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:50 smithi046 ceph-mon[28128]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:50.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:50 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3049619910' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:01:50.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:50 smithi073 ceph-mon[35473]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:50.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:50 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3049619910' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:01:50.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705718 got 38654705720 for osd.0 2024-09-10T23:01:50.801 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:51.418 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561038 got 188978561040 for osd.6 2024-09-10T23:01:51.418 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 -- 172.21.15.46:0/349265152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 msgr2=0x7fbd2010ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 --2- 172.21.15.46:0/349265152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2010ab80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009880 tx=0x7fbd0802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 -- 172.21.15.46:0/349265152 shutdown_connections 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 --2- 172.21.15.46:0/349265152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2010ab80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 --2- 172.21.15.46:0/349265152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 0x7fbd20105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 -- 172.21.15.46:0/349265152 >> 172.21.15.46:0/349265152 conn(0x7fbd20100780 msgr2=0x7fbd20102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 -- 172.21.15.46:0/349265152 shutdown_connections 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.177+0000 7fbd25600640 1 -- 172.21.15.46:0/349265152 wait complete. 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.178+0000 7fbd25600640 1 Processor -- start 2024-09-10T23:01:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.178+0000 7fbd25600640 1 -- start start 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.178+0000 7fbd25600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 0x7fbd2019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.178+0000 7fbd25600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.178+0000 7fbd25600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20111d60 con 0x7fbd2010a740 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd25600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20111be0 con 0x7fbd20104d30 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd17e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd17e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2019ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38370/0 (socket says 172.21.15.46:38370) 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd17e00640 1 -- 172.21.15.46:0/2921600464 learned_addr learned my addr 172.21.15.46:0/2921600464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd1ea00640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 0x7fbd2019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd17e00640 1 -- 172.21.15.46:0/2921600464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 msgr2=0x7fbd2019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd17e00640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 0x7fbd2019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd17e00640 1 -- 172.21.15.46:0/2921600464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd201a0220 con 0x7fbd2010a740 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.179+0000 7fbd1ea00640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 0x7fbd2019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:01:51.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.180+0000 7fbd17e00640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2019ae80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd0802a9c0 tx=0x7fbd080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.180+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd0803f070 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.180+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd08004a90 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.180+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd08035030 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.180+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd201a04b0 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.180+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd201a09e0 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.181+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2019b600 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.182+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fbd08003ba0 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.183+0000 7fbd17400640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbd0407a320 0x7fbd0407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.183+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fbd080bdca0 con 0x7fbd2010a740 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.184+0000 7fbd1ea00640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbd0407a320 0x7fbd0407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.184+0000 7fbd1ea00640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbd0407a320 0x7fbd0407c7e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005d00 tx=0x7fbd10005c70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:51.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.188+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbd2019b600 con 0x7fbd2010a740 2024-09-10T23:01:51.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.391+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbd2010cee0 con 0x7fbd2010a740 2024-09-10T23:01:51.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.391+0000 7fbd17400640 1 -- 172.21.15.46:0/2921600464 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd08085650 con 0x7fbd2010a740 2024-09-10T23:01:51.523 INFO:teuthology.orchestra.run.smithi046.stdout:133143986205 2024-09-10T23:01:51.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbd0407a320 msgr2=0x7fbd0407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:51.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbd0407a320 0x7fbd0407c7e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005d00 tx=0x7fbd10005c70 comp rx=0 tx=0).stop 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 msgr2=0x7fbd2019ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2019ae80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd0802a9c0 tx=0x7fbd080045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 shutdown_connections 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbd0407a320 0x7fbd0407c7e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2010a740 0x7fbd2019ae80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 --2- 172.21.15.46:0/2921600464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd20104d30 0x7fbd2019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 >> 172.21.15.46:0/2921600464 conn(0x7fbd20100780 msgr2=0x7fbd20102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 shutdown_connections 2024-09-10T23:01:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:51.394+0000 7fbd25600640 1 -- 172.21.15.46:0/2921600464 wait complete. 2024-09-10T23:01:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:52.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:52 smithi046 ceph-mon[28128]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:52.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:52 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2921600464' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:01:52.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986202 got 133143986205 for osd.4 2024-09-10T23:01:52.318 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:52.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:52 smithi073 ceph-mon[35473]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:52.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:52 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2921600464' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 -- 172.21.15.46:0/37243171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 msgr2=0x7fbef41089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 --2- 172.21.15.46:0/37243171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef41089b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009880 tx=0x7fbedc02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 -- 172.21.15.46:0/37243171 shutdown_connections 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 --2- 172.21.15.46:0/37243171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef41089b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 --2- 172.21.15.46:0/37243171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef4102b60 0x7fbef4102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 -- 172.21.15.46:0/37243171 >> 172.21.15.46:0/37243171 conn(0x7fbef40fe5b0 msgr2=0x7fbef41009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 -- 172.21.15.46:0/37243171 shutdown_connections 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.863+0000 7fbefa400640 1 -- 172.21.15.46:0/37243171 wait complete. 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.864+0000 7fbefa400640 1 Processor -- start 2024-09-10T23:01:52.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.864+0000 7fbefa400640 1 -- start start 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbefa400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef4102b60 0x7fbef419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbefa400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbefa400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410fb90 con 0x7fbef4108570 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbefa400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410fa10 con 0x7fbef4102b60 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbeebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbeebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49008/0 (socket says 172.21.15.46:49008) 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbeebe00640 1 -- 172.21.15.46:0/3569768144 learned_addr learned my addr 172.21.15.46:0/3569768144 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbef3400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef4102b60 0x7fbef419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbeebe00640 1 -- 172.21.15.46:0/3569768144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef4102b60 msgr2=0x7fbef419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbeebe00640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef4102b60 0x7fbef419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.865+0000 7fbeebe00640 1 -- 172.21.15.46:0/3569768144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef41a0240 con 0x7fbef4108570 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.866+0000 7fbeebe00640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef419aea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbedc006010 tx=0x7fbedc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.866+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbedc03f070 con 0x7fbef4108570 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.866+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbedc0049d0 con 0x7fbef4108570 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.866+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbedc035030 con 0x7fbef4108570 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.866+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef41a04d0 con 0x7fbef4108570 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.866+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef41a0a80 con 0x7fbef4108570 2024-09-10T23:01:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.867+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef419b620 con 0x7fbef4108570 2024-09-10T23:01:52.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.868+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fbedc0035f0 con 0x7fbef4108570 2024-09-10T23:01:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.871+0000 7fbef0c00640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbed807a320 0x7fbed807c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.871+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fbedc0bdbd0 con 0x7fbef4108570 2024-09-10T23:01:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.871+0000 7fbef3400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbed807a320 0x7fbed807c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.872+0000 7fbef3400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbed807a320 0x7fbed807c7e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbee400bbe0 tx=0x7fbee400b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:52.875+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbef419b620 con 0x7fbef4108570 2024-09-10T23:01:53.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.071+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbef41000a0 con 0x7fbef4108570 2024-09-10T23:01:53.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.072+0000 7fbef0c00640 1 -- 172.21.15.46:0/3569768144 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbedc089a00 con 0x7fbef4108570 2024-09-10T23:01:53.074 INFO:teuthology.orchestra.run.smithi046.stdout:81604378665 2024-09-10T23:01:53.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbed807a320 msgr2=0x7fbed807c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:53.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbed807a320 0x7fbed807c7e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbee400bbe0 tx=0x7fbee400b390 comp rx=0 tx=0).stop 2024-09-10T23:01:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 msgr2=0x7fbef419aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef419aea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbedc006010 tx=0x7fbedc0045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 shutdown_connections 2024-09-10T23:01:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbed807a320 0x7fbed807c7e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4108570 0x7fbef419aea0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 --2- 172.21.15.46:0/3569768144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef4102b60 0x7fbef419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:53.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 >> 172.21.15.46:0/3569768144 conn(0x7fbef40fe5b0 msgr2=0x7fbef4105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:53.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 shutdown_connections 2024-09-10T23:01:53.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:53.074+0000 7fbefa400640 1 -- 172.21.15.46:0/3569768144 wait complete. 2024-09-10T23:01:53.911 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378662 got 81604378665 for osd.2 2024-09-10T23:01:53.911 DEBUG:teuthology.parallel:result is None 2024-09-10T23:01:53.911 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:01:53.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:01:54.295 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:54.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:54 smithi046 ceph-mon[28128]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:54.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:54 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3569768144' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:01:54.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:54 smithi073 ceph-mon[35473]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:54.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:54 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3569768144' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:01:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 -- 172.21.15.46:0/3246850032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 msgr2=0x7f1004105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 --2- 172.21.15.46:0/3246850032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f1004105110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009880 tx=0x7f0ff802a4b0 comp rx=0 tx=0).stop 2024-09-10T23:01:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 -- 172.21.15.46:0/3246850032 shutdown_connections 2024-09-10T23:01:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 --2- 172.21.15.46:0/3246850032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100410a740 0x7f100410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 --2- 172.21.15.46:0/3246850032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f1004105110 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 -- 172.21.15.46:0/3246850032 >> 172.21.15.46:0/3246850032 conn(0x7f1004100780 msgr2=0x7f1004102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 -- 172.21.15.46:0/3246850032 shutdown_connections 2024-09-10T23:01:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.818+0000 7f100be00640 1 -- 172.21.15.46:0/3246850032 wait complete. 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.819+0000 7f100be00640 1 Processor -- start 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.819+0000 7f100be00640 1 -- start start 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f100be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f100419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f100be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100410a740 0x7f100419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f100be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111d80 con 0x7f1004104d30 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f100be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111c00 con 0x7f100410a740 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1009400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f100419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1009400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f100419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49038/0 (socket says 172.21.15.46:49038) 2024-09-10T23:01:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1009400640 1 -- 172.21.15.46:0/2179013036 learned_addr learned my addr 172.21.15.46:0/2179013036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1008a00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100410a740 0x7f100419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1009400640 1 -- 172.21.15.46:0/2179013036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100410a740 msgr2=0x7f100419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1009400640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100410a740 0x7f100419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.820+0000 7f1009400640 1 -- 172.21.15.46:0/2179013036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10041a0280 con 0x7f1004104d30 2024-09-10T23:01:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.821+0000 7f1009400640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f100419a9a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006010 tx=0x7f0ff80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.821+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ff803f070 con 0x7f1004104d30 2024-09-10T23:01:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.821+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ff80049d0 con 0x7f1004104d30 2024-09-10T23:01:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.821+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ff8035030 con 0x7f1004104d30 2024-09-10T23:01:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.821+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10041a0510 con 0x7f1004104d30 2024-09-10T23:01:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.821+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10041a0a40 con 0x7f1004104d30 2024-09-10T23:01:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.822+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100419b660 con 0x7f1004104d30 2024-09-10T23:01:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.824+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f0ff80035f0 con 0x7f1004104d30 2024-09-10T23:01:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.825+0000 7f1002000640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f0fec07a320 0x7f0fec07c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.825+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f0ff80bdc70 con 0x7f1004104d30 2024-09-10T23:01:54.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.825+0000 7f1008a00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f0fec07a320 0x7f0fec07c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:54.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.825+0000 7f1008a00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f0fec07a320 0x7f0fec07c7e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1004107410 tx=0x7f0ff000b390 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:54.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:54.829+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f100419b660 con 0x7f1004104d30 2024-09-10T23:01:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.022+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f100419bb30 con 0x7f0fec07a320 2024-09-10T23:01:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.023+0000 7f1002000640 1 -- 172.21.15.46:0/2179013036 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14509 (secure 0 0 0) 0x7f100419bb30 con 0x7f0fec07a320 2024-09-10T23:01:55.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f0fec07a320 msgr2=0x7f0fec07c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f0fec07a320 0x7f0fec07c7e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1004107410 tx=0x7f0ff000b390 comp rx=0 tx=0).stop 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 msgr2=0x7f100419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f100419a9a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006010 tx=0x7f0ff80045e0 comp rx=0 tx=0).stop 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 shutdown_connections 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f0fec07a320 0x7f0fec07c7e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100410a740 0x7f100419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 --2- 172.21.15.46:0/2179013036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1004104d30 0x7f100419a9a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 >> 172.21.15.46:0/2179013036 conn(0x7f1004100780 msgr2=0x7f1004102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 shutdown_connections 2024-09-10T23:01:55.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:55.026+0000 7f100be00640 1 -- 172.21.15.46:0/2179013036 wait complete. 2024-09-10T23:01:55.751 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-10T23:01:54.963918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":230424,"kb_used_data":5836,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":749730792,"statfs":{"total":767960285184,"available":767724331008,"internally_reserved":0,"allocated":5976064,"data_stored":3449920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002049"},"pg_stats":[{"pgid":"1.0","version":"21'72","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-10T23:01:15.987736+0000","last_change":"2024-09-10T23:01:15.987321+0000","last_active":"2024-09-10T23:01:15.987736+0000","last_peered":"2024-09-10T23:01:15.987736+0000","last_clean":"2024-09-10T23:01:15.987736+0000","last_became_active":"2024-09-10T23:01:15.980837+0000","last_became_peered":"2024-09-10T23:01:15.980837+0000","last_unstale":"2024-09-10T23:01:15.987736+0000","last_undegraded":"2024-09-10T23:01:15.987736+0000","last_fullsized":"2024-09-10T23:01:15.987736+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:58:33.977899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:58:33.977899+0000","last_clean_scrub_stamp":"2024-09-10T22:58:33.977899+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:01.875380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1118208,"data_stored":800220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1118208,"data_stored":800220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717604,"statfs":{"total":95995035648,"available":95966826496,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717612,"statfs":{"total":95995035648,"available":95966834688,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31712,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713440,"statfs":{"total":95995035648,"available":95962562560,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713452,"statfs":{"total":95995035648,"available":95962574848,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717604,"statfs":{"total":95995035648,"available":95966826496,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1118208,"data_stored":800220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:01:55.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:01:56.134 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:56.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:56 smithi046 ceph-mon[28128]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:56.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:56 smithi046 ceph-mon[28128]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:01:56.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:56 smithi073 ceph-mon[35473]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:56.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:56 smithi073 ceph-mon[35473]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 -- 172.21.15.46:0/1649073851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe400104d30 msgr2=0x7fe400105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 --2- 172.21.15.46:0/1649073851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe400104d30 0x7fe400105110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009880 tx=0x7fe3f002a4b0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 -- 172.21.15.46:0/1649073851 shutdown_connections 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 --2- 172.21.15.46:0/1649073851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe40010a740 0x7fe40010ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 --2- 172.21.15.46:0/1649073851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe400104d30 0x7fe400105110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 -- 172.21.15.46:0/1649073851 >> 172.21.15.46:0/1649073851 conn(0x7fe400100780 msgr2=0x7fe400102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 -- 172.21.15.46:0/1649073851 shutdown_connections 2024-09-10T23:01:56.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.678+0000 7fe405e00640 1 -- 172.21.15.46:0/1649073851 wait complete. 2024-09-10T23:01:56.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.679+0000 7fe405e00640 1 Processor -- start 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.679+0000 7fe405e00640 1 -- start start 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.679+0000 7fe405e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe400104d30 0x7fe40019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.679+0000 7fe405e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 0x7fe40019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.679+0000 7fe405e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe400111de0 con 0x7fe40010a740 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.679+0000 7fe405e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe400111c60 con 0x7fe400104d30 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 0x7fe40019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 0x7fe40019af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49054/0 (socket says 172.21.15.46:49054) 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 -- 172.21.15.46:0/2092996164 learned_addr learned my addr 172.21.15.46:0/2092996164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3fea00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe400104d30 0x7fe40019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 -- 172.21.15.46:0/2092996164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe400104d30 msgr2=0x7fe40019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:56.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe400104d30 0x7fe40019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 -- 172.21.15.46:0/2092996164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4001a02e0 con 0x7fe40010a740 2024-09-10T23:01:56.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.680+0000 7fe3f6000640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 0x7fe40019af40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800b420 tx=0x7fe3e800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.681+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3e8011630 con 0x7fe40010a740 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.681+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e8016070 con 0x7fe40010a740 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.681+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3e8010b80 con 0x7fe40010a740 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.681+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4001a05d0 con 0x7fe40010a740 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.681+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4001a0be0 con 0x7fe40010a740 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.682+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40019b6c0 con 0x7fe40010a740 2024-09-10T23:01:56.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.683+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fe3e8010d40 con 0x7fe40010a740 2024-09-10T23:01:56.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.685+0000 7fe404a00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe3e407a370 0x7fe3e407c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:56.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.685+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fe3e809c5e0 con 0x7fe40010a740 2024-09-10T23:01:56.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.685+0000 7fe3fea00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe3e407a370 0x7fe3e407c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:56.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.686+0000 7fe3fea00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe3e407a370 0x7fe3e407c830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000c00 tx=0x7fe3f0005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:56.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.689+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe40019b6c0 con 0x7fe40010a740 2024-09-10T23:01:56.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.881+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4001a0ef0 con 0x7fe3e407a370 2024-09-10T23:01:56.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.882+0000 7fe404a00640 1 -- 172.21.15.46:0/2092996164 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14509 (secure 0 0 0) 0x7fe4001a0ef0 con 0x7fe3e407a370 2024-09-10T23:01:56.884 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:56.884 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-10T23:01:56.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe3e407a370 msgr2=0x7fe3e407c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:56.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe3e407a370 0x7fe3e407c830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000c00 tx=0x7fe3f0005a20 comp rx=0 tx=0).stop 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 msgr2=0x7fe40019af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 0x7fe40019af40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800b420 tx=0x7fe3e800b8e0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 shutdown_connections 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fe3e407a370 0x7fe3e407c830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe40010a740 0x7fe40019af40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 --2- 172.21.15.46:0/2092996164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe400104d30 0x7fe40019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 >> 172.21.15.46:0/2092996164 conn(0x7fe400100780 msgr2=0x7fe400102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 shutdown_connections 2024-09-10T23:01:56.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:56.885+0000 7fe405e00640 1 -- 172.21.15.46:0/2092996164 wait complete. 2024-09-10T23:01:57.654 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-10T23:01:54.963918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":230424,"kb_used_data":5836,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":749730792,"statfs":{"total":767960285184,"available":767724331008,"internally_reserved":0,"allocated":5976064,"data_stored":3449920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002049"},"pg_stats":[{"pgid":"1.0","version":"21'72","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-10T23:01:15.987736+0000","last_change":"2024-09-10T23:01:15.987321+0000","last_active":"2024-09-10T23:01:15.987736+0000","last_peered":"2024-09-10T23:01:15.987736+0000","last_clean":"2024-09-10T23:01:15.987736+0000","last_became_active":"2024-09-10T23:01:15.980837+0000","last_became_peered":"2024-09-10T23:01:15.980837+0000","last_unstale":"2024-09-10T23:01:15.987736+0000","last_undegraded":"2024-09-10T23:01:15.987736+0000","last_fullsized":"2024-09-10T23:01:15.987736+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:58:33.977899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:58:33.977899+0000","last_clean_scrub_stamp":"2024-09-10T22:58:33.977899+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:01.875380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1118208,"data_stored":800220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1118208,"data_stored":800220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717604,"statfs":{"total":95995035648,"available":95966826496,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717612,"statfs":{"total":95995035648,"available":95966834688,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31712,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713440,"statfs":{"total":95995035648,"available":95962562560,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713452,"statfs":{"total":95995035648,"available":95962574848,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717604,"statfs":{"total":95995035648,"available":95966826496,"internally_reserved":0,"allocated":524288,"data_stored":209852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1118208,"data_stored":800220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:01:57.655 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:01:57.655 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:01:57.655 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:01:57.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T23:01:58.037 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:01:58.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:58 smithi046 ceph-mon[28128]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:01:58.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:58 smithi046 ceph-mon[28128]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:58 smithi073 ceph-mon[35473]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:01:58.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:58 smithi073 ceph-mon[35473]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 -- 172.21.15.46:0/3609692326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88102b60 msgr2=0x7f9e88102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/3609692326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88102b60 0x7f9e88102f40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009880 tx=0x7f9e7c02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 -- 172.21.15.46:0/3609692326 shutdown_connections 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/3609692326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e88108570 0x7f9e881089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/3609692326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88102b60 0x7f9e88102f40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 -- 172.21.15.46:0/3609692326 >> 172.21.15.46:0/3609692326 conn(0x7f9e880fe5b0 msgr2=0x7f9e881009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 -- 172.21.15.46:0/3609692326 shutdown_connections 2024-09-10T23:01:58.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.539+0000 7f9e8fa00640 1 -- 172.21.15.46:0/3609692326 wait complete. 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.540+0000 7f9e8fa00640 1 Processor -- start 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.540+0000 7f9e8fa00640 1 -- start start 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.540+0000 7f9e8fa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e88102b60 0x7f9e8819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.540+0000 7f9e8fa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 0x7f9e8819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.540+0000 7f9e8fa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810fb90 con 0x7f9e88108570 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.540+0000 7f9e8fa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810fa10 con 0x7f9e88102b60 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 0x7f9e8819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 0x7f9e8819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49060/0 (socket says 172.21.15.46:49060) 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 -- 172.21.15.46:0/979501000 learned_addr learned my addr 172.21.15.46:0/979501000 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e8d000640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e88102b60 0x7f9e8819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 -- 172.21.15.46:0/979501000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e88102b60 msgr2=0x7f9e8819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e88102b60 0x7f9e8819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 -- 172.21.15.46:0/979501000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881a02c0 con 0x7f9e88108570 2024-09-10T23:01:58.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.541+0000 7f9e87e00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 0x7f9e8819af20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400d8d0 tx=0x7f9e7400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:58.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.542+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e74017070 con 0x7f9e88108570 2024-09-10T23:01:58.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.542+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e74010460 con 0x7f9e88108570 2024-09-10T23:01:58.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.542+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e7400f5f0 con 0x7f9e88108570 2024-09-10T23:01:58.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.542+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e881a05b0 con 0x7f9e88108570 2024-09-10T23:01:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.542+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881a0b40 con 0x7f9e88108570 2024-09-10T23:01:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.543+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8819b6a0 con 0x7f9e88108570 2024-09-10T23:01:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.544+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f9e74010930 con 0x7f9e88108570 2024-09-10T23:01:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.545+0000 7f9e85600640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9e7007a370 0x7f9e7007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:01:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.545+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f9e7409cbd0 con 0x7f9e88108570 2024-09-10T23:01:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.545+0000 7f9e8d000640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9e7007a370 0x7f9e7007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:01:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.546+0000 7f9e8d000640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9e7007a370 0x7f9e7007c830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c005ab0 tx=0x7f9e7c005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:01:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.550+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9e8819b6a0 con 0x7f9e88108570 2024-09-10T23:01:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.784+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9e88103e10 con 0x7f9e88108570 2024-09-10T23:01:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.785+0000 7f9e85600640 1 -- 172.21.15.46:0/979501000 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9e740646a0 con 0x7f9e88108570 2024-09-10T23:01:58.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:01:58.787 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9e7007a370 msgr2=0x7f9e7007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9e7007a370 0x7f9e7007c830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c005ab0 tx=0x7f9e7c005a20 comp rx=0 tx=0).stop 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 msgr2=0x7f9e8819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 0x7f9e8819af20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400d8d0 tx=0x7f9e7400dd90 comp rx=0 tx=0).stop 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 shutdown_connections 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f9e7007a370 0x7f9e7007c830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e88108570 0x7f9e8819af20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 --2- 172.21.15.46:0/979501000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e88102b60 0x7f9e8819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 >> 172.21.15.46:0/979501000 conn(0x7f9e880fe5b0 msgr2=0x7f9e88075480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:01:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 shutdown_connections 2024-09-10T23:01:58.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:01:58.788+0000 7f9e8fa00640 1 -- 172.21.15.46:0/979501000 wait complete. 2024-09-10T23:01:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:01:59 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/979501000' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:01:59.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:01:59 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/979501000' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:01:59.537 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:01:59.537 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T23:01:59.538 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:01:59.549 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-10T23:01:59.549 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T23:01:59.933 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:00.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:00 smithi046 ceph-mon[28128]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:00.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:00 smithi073 ceph-mon[35473]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.440+0000 7fb24b200640 1 -- 172.21.15.46:0/246250032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c077a10 msgr2=0x7fb24c077e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.440+0000 7fb24b200640 1 --2- 172.21.15.46:0/246250032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c077a10 0x7fb24c077e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009c20 tx=0x7fb23c02a970 comp rx=0 tx=0).stop 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.440+0000 7fb24b200640 1 -- 172.21.15.46:0/246250032 shutdown_connections 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.440+0000 7fb24b200640 1 --2- 172.21.15.46:0/246250032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c078b70 0x7fb24c078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.440+0000 7fb24b200640 1 --2- 172.21.15.46:0/246250032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c077a10 0x7fb24c077e10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.440+0000 7fb24b200640 1 -- 172.21.15.46:0/246250032 >> 172.21.15.46:0/246250032 conn(0x7fb24c1000e0 msgr2=0x7fb24c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.441+0000 7fb24b200640 1 -- 172.21.15.46:0/246250032 shutdown_connections 2024-09-10T23:02:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.441+0000 7fb24b200640 1 -- 172.21.15.46:0/246250032 wait complete. 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb24b200640 1 Processor -- start 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb24b200640 1 -- start start 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb24b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c077a10 0x7fb24c19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb24b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 0x7fb24c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb24b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c111940 con 0x7fb24c078b70 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb24b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1117c0 con 0x7fb24c077a10 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb241400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 0x7fb24c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb241400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 0x7fb24c19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49092/0 (socket says 172.21.15.46:49092) 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb241400640 1 -- 172.21.15.46:0/2558560847 learned_addr learned my addr 172.21.15.46:0/2558560847 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.442+0000 7fb249e00640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c077a10 0x7fb24c19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb241400640 1 -- 172.21.15.46:0/2558560847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c077a10 msgr2=0x7fb24c19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb241400640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c077a10 0x7fb24c19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb241400640 1 -- 172.21.15.46:0/2558560847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24c19f9e0 con 0x7fb24c078b70 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb241400640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 0x7fb24c19ee10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b420 tx=0x7fb23400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb234011630 con 0x7fb24c078b70 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb234016070 con 0x7fb24c078b70 2024-09-10T23:02:00.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24c19fcd0 con 0x7fb24c078b70 2024-09-10T23:02:00.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb234010b80 con 0x7fb24c078b70 2024-09-10T23:02:00.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.443+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24c1a02e0 con 0x7fb24c078b70 2024-09-10T23:02:00.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.445+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24c077e90 con 0x7fb24c078b70 2024-09-10T23:02:00.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.446+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fb2340117d0 con 0x7fb24c078b70 2024-09-10T23:02:00.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.447+0000 7fb243400640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb23007a320 0x7fb23007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:00.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.447+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fb23409c660 con 0x7fb24c078b70 2024-09-10T23:02:00.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.447+0000 7fb249e00640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb23007a320 0x7fb23007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:00.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.448+0000 7fb249e00640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb23007a320 0x7fb23007c7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb23c005e30 tx=0x7fb23c03c040 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:00.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.451+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb234064010 con 0x7fb24c078b70 2024-09-10T23:02:00.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.662+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fb24c063590 con 0x7fb23007a320 2024-09-10T23:02:00.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.663+0000 7fb243400640 1 -- 172.21.15.46:0/2558560847 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb24c063590 con 0x7fb23007a320 2024-09-10T23:02:00.665 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2024-09-10T23:02:00.665 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2024-09-10T23:02:00.665 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2024-09-10T23:02:00.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb23007a320 msgr2=0x7fb23007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb23007a320 0x7fb23007c7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb23c005e30 tx=0x7fb23c03c040 comp rx=0 tx=0).stop 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 msgr2=0x7fb24c19ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 0x7fb24c19ee10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b420 tx=0x7fb23400b8e0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 shutdown_connections 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fb23007a320 0x7fb23007c7e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb24c078b70 0x7fb24c19ee10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 --2- 172.21.15.46:0/2558560847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c077a10 0x7fb24c19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.665+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 >> 172.21.15.46:0/2558560847 conn(0x7fb24c1000e0 msgr2=0x7fb24c10fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.666+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 shutdown_connections 2024-09-10T23:02:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:00.666+0000 7fb24b200640 1 -- 172.21.15.46:0/2558560847 wait complete. 2024-09-10T23:02:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:01 smithi046 ceph-mon[28128]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:01 smithi073 ceph-mon[35473]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:01.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T23:02:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:02.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:02 smithi046 ceph-mon[28128]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:02.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 -- 172.21.15.46:0/3998550553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 msgr2=0x7fd1f8105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 --2- 172.21.15.46:0/3998550553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f8105fa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009880 tx=0x7fd1e402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 -- 172.21.15.46:0/3998550553 shutdown_connections 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 --2- 172.21.15.46:0/3998550553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f8105fa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 --2- 172.21.15.46:0/3998550553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f81049c0 0x7fd1f8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 -- 172.21.15.46:0/3998550553 >> 172.21.15.46:0/3998550553 conn(0x7fd1f81002d0 msgr2=0x7fd1f81026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:02.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 -- 172.21.15.46:0/3998550553 shutdown_connections 2024-09-10T23:02:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.432+0000 7fd1fde00640 1 -- 172.21.15.46:0/3998550553 wait complete. 2024-09-10T23:02:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.433+0000 7fd1fde00640 1 Processor -- start 2024-09-10T23:02:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.433+0000 7fd1fde00640 1 -- start start 2024-09-10T23:02:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.433+0000 7fd1fde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f81049c0 0x7fd1f819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.433+0000 7fd1fde00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.433+0000 7fd1fde00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f810d6b0 con 0x7fd1f8105b20 2024-09-10T23:02:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.433+0000 7fd1fde00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f810d530 con 0x7fd1f81049c0 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49110/0 (socket says 172.21.15.46:49110) 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 -- 172.21.15.46:0/765878703 learned_addr learned my addr 172.21.15.46:0/765878703 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6a00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f81049c0 0x7fd1f819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 -- 172.21.15.46:0/765878703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f81049c0 msgr2=0x7fd1f819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f81049c0 0x7fd1f819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 -- 172.21.15.46:0/765878703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f819b6c0 con 0x7fd1f8105b20 2024-09-10T23:02:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.434+0000 7fd1f6000640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f819aaf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40099a0 tx=0x7fd1e4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.435+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1e403f070 con 0x7fd1f8105b20 2024-09-10T23:02:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.435+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1e4004350 con 0x7fd1f8105b20 2024-09-10T23:02:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.435+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1e4035030 con 0x7fd1f8105b20 2024-09-10T23:02:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.435+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f819b950 con 0x7fd1f8105b20 2024-09-10T23:02:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.435+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f819bf00 con 0x7fd1f8105b20 2024-09-10T23:02:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.436+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f8104dc0 con 0x7fd1f8105b20 2024-09-10T23:02:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.437+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fd1e4003b10 con 0x7fd1f8105b20 2024-09-10T23:02:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.438+0000 7fd1fca00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd1dc07a370 0x7fd1dc07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.438+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fd1e40bdbe0 con 0x7fd1f8105b20 2024-09-10T23:02:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.438+0000 7fd1f6a00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd1dc07a370 0x7fd1dc07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.439+0000 7fd1f6a00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd1dc07a370 0x7fd1dc07c830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009bd0 tx=0x7fd1e8005f90 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:02.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.443+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd1e40899f0 con 0x7fd1f8105b20 2024-09-10T23:02:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:02 smithi073 ceph-mon[35473]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.653+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd1f8063590 con 0x7fd1dc07a370 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.662+0000 7fd1fca00640 1 -- 172.21.15.46:0/765878703 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3410 (secure 0 0 0) 0x7fd1f8063590 con 0x7fd1dc07a370 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 2m ago 7m 13.7M - 0.27.0 11f11916f8cd 5dc0cab666d3 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (7m) 2m ago 7m 8162k - 19.3.0-4854-g8f219c47 589dd18248e4 aae0148e518e 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi073 smithi073 running (6m) 50s ago 6m 5347k - 19.3.0-4854-g8f219c47 589dd18248e4 297795669e84 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 2m ago 7m 6891k - 19.3.0-4854-g8f219c47 589dd18248e4 6bd078c35b35 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi073 smithi073 running (6m) 50s ago 6m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 838a05af458a 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 2m ago 6m 68.4M - c8b91775d855 54d44f40b26a 2024-09-10T23:02:02.664 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.eocvws smithi046 *:9283,8765,8443 running (8m) 2m ago 8m 509M - 19.3.0-4854-g8f219c47 589dd18248e4 986cb1497519 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi073.lkiuuj smithi073 *:8443,9283,8765 running (6m) 50s ago 6m 454M - 19.3.0-4854-g8f219c47 589dd18248e4 f15158d6d740 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 2m ago 8m 46.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 dff327a0adc6 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi073 smithi073 running (5m) 50s ago 5m 33.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 670ecdcdbc73 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 2m ago 7m 7289k - 1.7.0 72c9c2088986 6a5e744524b2 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 50s ago 6m 7524k - 1.7.0 72c9c2088986 dd620c9e7750 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 2m ago 4m 35.6M 2961M 19.3.0-4854-g8f219c47 589dd18248e4 4c6c1e0e2d52 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 2m ago 4m 36.5M 2961M 19.3.0-4854-g8f219c47 589dd18248e4 6c1e82951273 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 2m ago 3m 40.3M 2961M 19.3.0-4854-g8f219c47 589dd18248e4 ba009426794e 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi046 running (3m) 2m ago 3m 10.4M 2961M 19.3.0-4854-g8f219c47 589dd18248e4 6c73fc2bb8dc 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi073 running (2m) 50s ago 2m 41.9M 3728M 19.3.0-4854-g8f219c47 589dd18248e4 29c4185ca49a 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi073 running (2m) 50s ago 2m 43.2M 3728M 19.3.0-4854-g8f219c47 589dd18248e4 dc1a95893361 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 smithi073 running (89s) 50s ago 89s 32.1M 3728M 19.3.0-4854-g8f219c47 589dd18248e4 6a15ffb58ed0 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 smithi073 running (57s) 50s ago 56s 10.4M 3728M 19.3.0-4854-g8f219c47 589dd18248e4 555d46645959 2024-09-10T23:02:02.665 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 2m ago 6m 38.1M - 2.51.0 1d3b7f56885b 9d5f2be683d7 2024-09-10T23:02:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd1dc07a370 msgr2=0x7fd1dc07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd1dc07a370 0x7fd1dc07c830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009bd0 tx=0x7fd1e8005f90 comp rx=0 tx=0).stop 2024-09-10T23:02:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 msgr2=0x7fd1f819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f819aaf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40099a0 tx=0x7fd1e4005dc0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 shutdown_connections 2024-09-10T23:02:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fd1dc07a370 0x7fd1dc07c830 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8105b20 0x7fd1f819aaf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 --2- 172.21.15.46:0/765878703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f81049c0 0x7fd1f819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 >> 172.21.15.46:0/765878703 conn(0x7fd1f81002d0 msgr2=0x7fd1f8109030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.664+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 shutdown_connections 2024-09-10T23:02:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:02.665+0000 7fd1fde00640 1 -- 172.21.15.46:0/765878703 wait complete. 2024-09-10T23:02:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:03 smithi046 ceph-mon[28128]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:03.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T23:02:03.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:03 smithi073 ceph-mon[35473]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:03.806 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:04.258 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:04 smithi046 ceph-mon[28128]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 -- 172.21.15.46:0/1108924829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 msgr2=0x7f3e1c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 --2- 172.21.15.46:0/1108924829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c104dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009880 tx=0x7f3e1002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 -- 172.21.15.46:0/1108924829 shutdown_connections 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 --2- 172.21.15.46:0/1108924829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e1c105b20 0x7f3e1c105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 --2- 172.21.15.46:0/1108924829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c104dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 -- 172.21.15.46:0/1108924829 >> 172.21.15.46:0/1108924829 conn(0x7f3e1c1002d0 msgr2=0x7f3e1c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 -- 172.21.15.46:0/1108924829 shutdown_connections 2024-09-10T23:02:04.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.281+0000 7f3e24400640 1 -- 172.21.15.46:0/1108924829 wait complete. 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.282+0000 7f3e24400640 1 Processor -- start 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.282+0000 7f3e24400640 1 -- start start 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e24400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e24400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e1c105b20 0x7f3e1c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e24400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c10d6b0 con 0x7f3e1c1049c0 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e24400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c10d530 con 0x7f3e1c105b20 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c19a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60826/0 (socket says 172.21.15.46:60826) 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21a00640 1 -- 172.21.15.46:0/4045317903 learned_addr learned my addr 172.21.15.46:0/4045317903 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21000640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e1c105b20 0x7f3e1c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21a00640 1 -- 172.21.15.46:0/4045317903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e1c105b20 msgr2=0x7f3e1c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:04.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21a00640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e1c105b20 0x7f3e1c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.283+0000 7f3e21a00640 1 -- 172.21.15.46:0/4045317903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c19b6e0 con 0x7f3e1c1049c0 2024-09-10T23:02:04.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.284+0000 7f3e21a00640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c19a530 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3e10004dd0 tx=0x7f3e10004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:04.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.284+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e1003f070 con 0x7f3e1c1049c0 2024-09-10T23:02:04.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.284+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e10004440 con 0x7f3e1c1049c0 2024-09-10T23:02:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.284+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c19b970 con 0x7f3e1c1049c0 2024-09-10T23:02:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.284+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e10035030 con 0x7f3e1c1049c0 2024-09-10T23:02:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.284+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c19bf20 con 0x7f3e1c1049c0 2024-09-10T23:02:04.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.285+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c10de00 con 0x7f3e1c1049c0 2024-09-10T23:02:04.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.286+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f3e100035f0 con 0x7f3e1c1049c0 2024-09-10T23:02:04.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.287+0000 7f3e1a000640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f3e0407a320 0x7f3e0407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:04.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.288+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f3e100bdd70 con 0x7f3e1c1049c0 2024-09-10T23:02:04.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.288+0000 7f3e21000640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f3e0407a320 0x7f3e0407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:04.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.288+0000 7f3e21000640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f3e0407a320 0x7f3e0407c7e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005fd0 tx=0x7f3e08005850 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:04.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.292+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e100857c0 con 0x7f3e1c1049c0 2024-09-10T23:02:04.481 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:04 smithi073 ceph-mon[35473]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:04.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.494+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3e1c063590 con 0x7f3e0407a320 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.499+0000 7f3e1a000640 1 -- 172.21.15.46:0/4045317903 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1290 (secure 0 0 0) 0x7f3e1c063590 con 0x7f3e0407a320 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter 2/2 2m ago 8m * 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:crash 2/2 2m ago 8m * 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:grafana ?:3000 1/1 2m ago 8m count:1 2024-09-10T23:02:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 2/2 2m ago 8m count:2 2024-09-10T23:02:04.502 INFO:teuthology.orchestra.run.smithi046.stdout:mon 2/2 2m ago 7m smithi046:172.21.15.46=smithi046;smithi073:172.21.15.73=smithi073;count:2 2024-09-10T23:02:04.502 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter ?:9100 2/2 2m ago 8m * 2024-09-10T23:02:04.502 INFO:teuthology.orchestra.run.smithi046.stdout:osd 8 2m ago - 2024-09-10T23:02:04.502 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus ?:9095 1/1 2m ago 8m count:1 2024-09-10T23:02:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f3e0407a320 msgr2=0x7f3e0407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f3e0407a320 0x7f3e0407c7e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005fd0 tx=0x7f3e08005850 comp rx=0 tx=0).stop 2024-09-10T23:02:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 msgr2=0x7f3e1c19a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c19a530 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3e10004dd0 tx=0x7f3e10004040 comp rx=0 tx=0).stop 2024-09-10T23:02:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 shutdown_connections 2024-09-10T23:02:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f3e0407a320 0x7f3e0407c7e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e1c105b20 0x7f3e1c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 --2- 172.21.15.46:0/4045317903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c19a530 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.501+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 >> 172.21.15.46:0/4045317903 conn(0x7f3e1c1002d0 msgr2=0x7f3e1c109050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.502+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 shutdown_connections 2024-09-10T23:02:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:04.502+0000 7f3e24400640 1 -- 172.21.15.46:0/4045317903 wait complete. 2024-09-10T23:02:05.195 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:05 smithi046 ceph-mon[28128]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:05.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T23:02:05.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:05 smithi073 ceph-mon[35473]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 -- 172.21.15.46:0/3708471334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc105b20 msgr2=0x7f07bc105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 --2- 172.21.15.46:0/3708471334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc105b20 0x7f07bc105fa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009880 tx=0x7f07a402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 -- 172.21.15.46:0/3708471334 shutdown_connections 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 --2- 172.21.15.46:0/3708471334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc105b20 0x7f07bc105fa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 --2- 172.21.15.46:0/3708471334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc1049c0 0x7f07bc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 -- 172.21.15.46:0/3708471334 >> 172.21.15.46:0/3708471334 conn(0x7f07bc1002d0 msgr2=0x7f07bc1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 -- 172.21.15.46:0/3708471334 shutdown_connections 2024-09-10T23:02:06.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.172+0000 7f07c0c00640 1 -- 172.21.15.46:0/3708471334 wait complete. 2024-09-10T23:02:06.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.173+0000 7f07c0c00640 1 Processor -- start 2024-09-10T23:02:06.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.173+0000 7f07c0c00640 1 -- start start 2024-09-10T23:02:06.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.173+0000 7f07c0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 0x7f07bc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:06.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.173+0000 7f07c0c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc105b20 0x7f07bc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:06.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.173+0000 7f07c0c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10d690 con 0x7f07bc1049c0 2024-09-10T23:02:06.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.173+0000 7f07c0c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10d510 con 0x7f07bc105b20 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 0x7f07bc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 0x7f07bc19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60836/0 (socket says 172.21.15.46:60836) 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 -- 172.21.15.46:0/1956999095 learned_addr learned my addr 172.21.15.46:0/1956999095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b3e00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc105b20 0x7f07bc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 -- 172.21.15.46:0/1956999095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc105b20 msgr2=0x7f07bc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc105b20 0x7f07bc19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 -- 172.21.15.46:0/1956999095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc19b6b0 con 0x7f07bc1049c0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b3e00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc105b20 0x7f07bc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.174+0000 7f07b9e00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 0x7f07bc19a500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c8a0 tx=0x7f07ac00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.175+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07ac0079b0 con 0x7f07bc1049c0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.175+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac00f450 con 0x7f07bc1049c0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.175+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc19b9a0 con 0x7f07bc1049c0 2024-09-10T23:02:06.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.175+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07ac018630 con 0x7f07bc1049c0 2024-09-10T23:02:06.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.175+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc19bfb0 con 0x7f07bc1049c0 2024-09-10T23:02:06.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.176+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07bc10dde0 con 0x7f07bc1049c0 2024-09-10T23:02:06.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.177+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f07ac007b50 con 0x7f07bc1049c0 2024-09-10T23:02:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.178+0000 7f07b2a00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f07a007a320 0x7f07a007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:06.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.178+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f07ac09d1c0 con 0x7f07bc1049c0 2024-09-10T23:02:06.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.178+0000 7f07b3e00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f07a007a320 0x7f07a007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:06.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.179+0000 7f07b3e00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f07a007a320 0x7f07a007c7e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07a40057c0 tx=0x7f07a4004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.182+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07ac014030 con 0x7f07bc1049c0 2024-09-10T23:02:06.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:06 smithi046 ceph-mon[28128]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:06.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:06 smithi073 ceph-mon[35473]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:06.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.383+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f07bc063590 con 0x7f07a007a320 2024-09-10T23:02:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.385+0000 7f07b2a00640 1 -- 172.21.15.46:0/1956999095 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+145 (secure 0 0 0) 0x7f07bc063590 con 0x7f07a007a320 2024-09-10T23:02:06.386 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2024-09-10T23:02:06.386 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2024-09-10T23:02:06.387 INFO:teuthology.orchestra.run.smithi046.stdout:smithi073 172.21.15.73 2024-09-10T23:02:06.387 INFO:teuthology.orchestra.run.smithi046.stdout:2 hosts in cluster 2024-09-10T23:02:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f07a007a320 msgr2=0x7f07a007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f07a007a320 0x7f07a007c7e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07a40057c0 tx=0x7f07a4004d70 comp rx=0 tx=0).stop 2024-09-10T23:02:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 msgr2=0x7f07bc19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 0x7f07bc19a500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c8a0 tx=0x7f07ac00cd60 comp rx=0 tx=0).stop 2024-09-10T23:02:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 shutdown_connections 2024-09-10T23:02:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f07a007a320 0x7f07a007c7e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc105b20 0x7f07bc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 --2- 172.21.15.46:0/1956999095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07bc1049c0 0x7f07bc19a500 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.387+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 >> 172.21.15.46:0/1956999095 conn(0x7f07bc1002d0 msgr2=0x7f07bc109010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.388+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 shutdown_connections 2024-09-10T23:02:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:06.388+0000 7f07c0c00640 1 -- 172.21.15.46:0/1956999095 wait complete. 2024-09-10T23:02:07.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T23:02:07.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:07 smithi046 ceph-mon[28128]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:07.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:07 smithi073 ceph-mon[35473]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 -- 172.21.15.46:0/4113663733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c06bb90 msgr2=0x7fec7c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 --2- 172.21.15.46:0/4113663733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c06bb90 0x7fec7c103190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009880 tx=0x7fec6c02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 -- 172.21.15.46:0/4113663733 shutdown_connections 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 --2- 172.21.15.46:0/4113663733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec7c103720 0x7fec7c105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 --2- 172.21.15.46:0/4113663733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c06bb90 0x7fec7c103190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 -- 172.21.15.46:0/4113663733 >> 172.21.15.46:0/4113663733 conn(0x7fec7c0fcfb0 msgr2=0x7fec7c0ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 -- 172.21.15.46:0/4113663733 shutdown_connections 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.130+0000 7fec80e00640 1 -- 172.21.15.46:0/4113663733 wait complete. 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.131+0000 7fec80e00640 1 Processor -- start 2024-09-10T23:02:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.131+0000 7fec80e00640 1 -- start start 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec80e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec7c06bb90 0x7fec7c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec80e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 0x7fec7c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec80e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c111ac0 con 0x7fec7c103720 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec80e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c111940 con 0x7fec7c06bb90 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec71400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 0x7fec7c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec71400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 0x7fec7c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60866/0 (socket says 172.21.15.46:60866) 2024-09-10T23:02:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec71400640 1 -- 172.21.15.46:0/2857539599 learned_addr learned my addr 172.21.15.46:0/2857539599 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec79e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec7c06bb90 0x7fec7c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec71400640 1 -- 172.21.15.46:0/2857539599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec7c06bb90 msgr2=0x7fec7c19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec71400640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec7c06bb90 0x7fec7c19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.132+0000 7fec71400640 1 -- 172.21.15.46:0/2857539599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c19fb10 con 0x7fec7c103720 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.133+0000 7fec71400640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 0x7fec7c19ef40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e940 tx=0x7fec6400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.133+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec6400cac0 con 0x7fec7c103720 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.133+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec6400cc60 con 0x7fec7c103720 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.133+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c19fe00 con 0x7fec7c103720 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.133+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec64003c60 con 0x7fec7c103720 2024-09-10T23:02:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.133+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c1a0410 con 0x7fec7c103720 2024-09-10T23:02:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.134+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c101180 con 0x7fec7c103720 2024-09-10T23:02:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.135+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fec64003e80 con 0x7fec7c103720 2024-09-10T23:02:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.136+0000 7fec73400640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fec6007a370 0x7fec6007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.137+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7fec6409d4d0 con 0x7fec7c103720 2024-09-10T23:02:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.137+0000 7fec79e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fec6007a370 0x7fec6007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.137+0000 7fec79e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fec6007a370 0x7fec6007c830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fec6c004dd0 tx=0x7fec6c009630 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:08.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.141+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec64064f00 con 0x7fec7c103720 2024-09-10T23:02:08.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:08 smithi046 ceph-mon[28128]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.343+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fec7c105530 con 0x7fec6007a370 2024-09-10T23:02:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.345+0000 7fec73400640 1 -- 172.21.15.46:0/2857539599 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7fec7c105530 con 0x7fec6007a370 2024-09-10T23:02:08.347 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T23:02:08.347 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-10T23:02:08.347 INFO:teuthology.orchestra.run.smithi046.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 51s ago Has a FileSystem, LVM detected 2024-09-10T23:02:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fec6007a370 msgr2=0x7fec6007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fec6007a370 0x7fec6007c830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fec6c004dd0 tx=0x7fec6c009630 comp rx=0 tx=0).stop 2024-09-10T23:02:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 msgr2=0x7fec7c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 0x7fec7c19ef40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e940 tx=0x7fec6400ee00 comp rx=0 tx=0).stop 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 shutdown_connections 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fec6007a370 0x7fec6007c830 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec7c103720 0x7fec7c19ef40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 --2- 172.21.15.46:0/2857539599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec7c06bb90 0x7fec7c19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 >> 172.21.15.46:0/2857539599 conn(0x7fec7c0fcfb0 msgr2=0x7fec7c0ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 shutdown_connections 2024-09-10T23:02:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:08.347+0000 7fec80e00640 1 -- 172.21.15.46:0/2857539599 wait complete. 2024-09-10T23:02:08.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:08 smithi073 ceph-mon[35473]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:09.265 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:02:09.273 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-10T23:02:09.273 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph fs volume create foo' 2024-09-10T23:02:09.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:09 smithi046 ceph-mon[28128]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:09.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:09 smithi073 ceph-mon[35473]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:09.657 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 -- 172.21.15.46:0/3277849554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c103760 msgr2=0x7f6c8c103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 --2- 172.21.15.46:0/3277849554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c103760 0x7f6c8c103be0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009880 tx=0x7f6c7402a4b0 comp rx=0 tx=0).stop 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 -- 172.21.15.46:0/3277849554 shutdown_connections 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 --2- 172.21.15.46:0/3277849554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c103760 0x7f6c8c103be0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 --2- 172.21.15.46:0/3277849554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c102600 0x7f6c8c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 -- 172.21.15.46:0/3277849554 >> 172.21.15.46:0/3277849554 conn(0x7f6c8c0fdef0 msgr2=0x7f6c8c100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:10.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 -- 172.21.15.46:0/3277849554 shutdown_connections 2024-09-10T23:02:10.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.227+0000 7f6c8b200640 1 -- 172.21.15.46:0/3277849554 wait complete. 2024-09-10T23:02:10.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.228+0000 7f6c8b200640 1 Processor -- start 2024-09-10T23:02:10.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c8b200640 1 -- start start 2024-09-10T23:02:10.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c8b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 0x7f6c8c076c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:10.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c8b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c103760 0x7f6c8c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:10.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c8b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c10b2f0 con 0x7f6c8c102600 2024-09-10T23:02:10.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c8b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c10b170 con 0x7f6c8c103760 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c89e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 0x7f6c8c076c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c89e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 0x7f6c8c076c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60886/0 (socket says 172.21.15.46:60886) 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c89e00640 1 -- 172.21.15.46:0/145553676 learned_addr learned my addr 172.21.15.46:0/145553676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c81400640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c103760 0x7f6c8c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c89e00640 1 -- 172.21.15.46:0/145553676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c103760 msgr2=0x7f6c8c075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.229+0000 7f6c89e00640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c103760 0x7f6c8c075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c89e00640 1 -- 172.21.15.46:0/145553676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c075a80 con 0x7f6c8c102600 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c81400640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c103760 0x7f6c8c075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c89e00640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 0x7f6c8c076c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00d6f0 tx=0x7f6c7c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:10.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c7c017070 con 0x7f6c8c102600 2024-09-10T23:02:10.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c7c00de00 con 0x7f6c8c102600 2024-09-10T23:02:10.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c075d70 con 0x7f6c8c102600 2024-09-10T23:02:10.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c7c0049d0 con 0x7f6c8c102600 2024-09-10T23:02:10.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.230+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c076380 con 0x7f6c8c102600 2024-09-10T23:02:10.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.231+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c102a00 con 0x7f6c8c102600 2024-09-10T23:02:10.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.234+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f6c7c004c80 con 0x7f6c8c102600 2024-09-10T23:02:10.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.235+0000 7f6c83400640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f6c7007a370 0x7f6c7007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:10.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.235+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5502+0+0 (secure 0 0 0) 0x7f6c7c09cfb0 con 0x7f6c8c102600 2024-09-10T23:02:10.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.235+0000 7f6c81400640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f6c7007a370 0x7f6c7007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:10.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.236+0000 7f6c81400640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f6c7007a370 0x7f6c7007c830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c74000c00 tx=0x7f6c74004d70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:10.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.238+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6c7c0ce220 con 0x7f6c8c102600 2024-09-10T23:02:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:10.455+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}) -- 0x7f6c8c1082b0 con 0x7f6c7007a370 2024-09-10T23:02:10.457 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:10 smithi046 ceph-mon[28128]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:10.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:10 smithi073 ceph-mon[35473]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:11.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:11 smithi073 ceph-mon[35473]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:11.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool create", "pool": "cephfs.foo.meta"} : dispatch 2024-09-10T23:02:11.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:11 smithi046 ceph-mon[28128]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:11.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool create", "pool": "cephfs.foo.meta"} : dispatch 2024-09-10T23:02:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.162+0000 7f6c83400640 1 -- 172.21.15.46:0/145553676 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6c8c1082b0 con 0x7f6c7007a370 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f6c7007a370 msgr2=0x7f6c7007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f6c7007a370 0x7f6c7007c830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c74000c00 tx=0x7f6c74004d70 comp rx=0 tx=0).stop 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 msgr2=0x7f6c8c076c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 0x7f6c8c076c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00d6f0 tx=0x7f6c7c00dbb0 comp rx=0 tx=0).stop 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 shutdown_connections 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f6c7007a370 0x7f6c7007c830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c8c103760 0x7f6c8c075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 --2- 172.21.15.46:0/145553676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c8c102600 0x7f6c8c076c60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 >> 172.21.15.46:0/145553676 conn(0x7f6c8c0fdef0 msgr2=0x7f6c8c107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.166+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 shutdown_connections 2024-09-10T23:02:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:12.167+0000 7f6c8b200640 1 -- 172.21.15.46:0/145553676 wait complete. 2024-09-10T23:02:12.505 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:12 smithi046 ceph-mon[28128]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:12.505 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2024-09-10T23:02:12.505 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:12 smithi046 ceph-mon[28128]: osdmap e53: 8 total, 8 up, 8 in 2024-09-10T23:02:12.505 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"} : dispatch 2024-09-10T23:02:12.506 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:12 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046[28124]: 2024-09-10T23:02:12.132+0000 7f4645600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:02:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:12 smithi073 ceph-mon[35473]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2024-09-10T23:02:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:12 smithi073 ceph-mon[35473]: osdmap e53: 8 total, 8 up, 8 in 2024-09-10T23:02:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"} : dispatch 2024-09-10T23:02:12.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- bash -c 'ceph fs volume create bar' 2024-09-10T23:02:13.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2024-09-10T23:02:13.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T23:02:13.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"} : dispatch 2024-09-10T23:02:13.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: osdmap e55: 8 total, 8 up, 8 in 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: fsmap foo:0 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: Saving service mds.foo spec with placement count:2 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.smithi046.twlkrf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi046.twlkrf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:13.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:13.408 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:13.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2024-09-10T23:02:13.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T23:02:13.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"} : dispatch 2024-09-10T23:02:13.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: osdmap e55: 8 total, 8 up, 8 in 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: fsmap foo:0 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: Saving service mds.foo spec with placement count:2 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.smithi046.twlkrf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi046.twlkrf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:13.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:14.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 -- 172.21.15.46:0/4084083467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c075b20 msgr2=0x7f762c075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:14.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 --2- 172.21.15.46:0/4084083467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c075b20 0x7f762c075fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7614009880 tx=0x7f761402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:14.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 -- 172.21.15.46:0/4084083467 shutdown_connections 2024-09-10T23:02:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 --2- 172.21.15.46:0/4084083467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c075b20 0x7f762c075fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 --2- 172.21.15.46:0/4084083467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c076f80 0x7f762c0755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 -- 172.21.15.46:0/4084083467 >> 172.21.15.46:0/4084083467 conn(0x7f762c0fe0a0 msgr2=0x7f762c1004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 -- 172.21.15.46:0/4084083467 shutdown_connections 2024-09-10T23:02:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.028+0000 7f7632800640 1 -- 172.21.15.46:0/4084083467 wait complete. 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.029+0000 7f7632800640 1 Processor -- start 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7632800640 1 -- start start 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7632800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c075b20 0x7f762c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7632800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 0x7f762c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7632800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f762c10d6c0 con 0x7f762c076f80 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7632800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f762c10d540 con 0x7f762c075b20 2024-09-10T23:02:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7622a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 0x7f762c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7622a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 0x7f762c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42388/0 (socket says 172.21.15.46:42388) 2024-09-10T23:02:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f7622a00640 1 -- 172.21.15.46:0/3574929124 learned_addr learned my addr 172.21.15.46:0/3574929124 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.030+0000 7f762b400640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c075b20 0x7f762c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7622a00640 1 -- 172.21.15.46:0/3574929124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c075b20 msgr2=0x7f762c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7622a00640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c075b20 0x7f762c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7622a00640 1 -- 172.21.15.46:0/3574929124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c19b720 con 0x7f762c076f80 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7622a00640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 0x7f762c19ab50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f76140099a0 tx=0x7f7614004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f761403f070 con 0x7f762c076f80 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7614004440 con 0x7f762c076f80 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7614035030 con 0x7f762c076f80 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c19b9b0 con 0x7f762c076f80 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.031+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c19bf60 con 0x7f762c076f80 2024-09-10T23:02:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.032+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c075fa0 con 0x7f762c076f80 2024-09-10T23:02:14.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.034+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f7614003c10 con 0x7f762c076f80 2024-09-10T23:02:14.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.035+0000 7f7628c00640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f761007a370 0x7f761007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:14.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.035+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6320+0+0 (secure 0 0 0) 0x7f76140be080 con 0x7f762c076f80 2024-09-10T23:02:14.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.035+0000 7f762b400640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f761007a370 0x7f761007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:14.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.036+0000 7f762b400640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f761007a370 0x7f761007c830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f761c005fd0 tx=0x7f761c005850 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:14.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.040+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76140857a0 con 0x7f762c076f80 2024-09-10T23:02:14.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:14.264+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 --> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}) -- 0x7f762c063590 con 0x7f761007a370 2024-09-10T23:02:14.423 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:14 smithi046 ceph-mon[28128]: Deploying daemon mds.foo.smithi046.twlkrf on smithi046 2024-09-10T23:02:14.423 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:14 smithi046 ceph-mon[28128]: pgmap v244: 65 pgs: 5 creating+peering, 59 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:14.423 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:14 smithi046 ceph-mon[28128]: osdmap e56: 8 total, 8 up, 8 in 2024-09-10T23:02:14.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:14 smithi073 ceph-mon[35473]: Deploying daemon mds.foo.smithi046.twlkrf on smithi046 2024-09-10T23:02:14.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:14 smithi073 ceph-mon[35473]: pgmap v244: 65 pgs: 5 creating+peering, 59 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:14.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:14 smithi073 ceph-mon[35473]: osdmap e56: 8 total, 8 up, 8 in 2024-09-10T23:02:15.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:15 smithi046 ceph-mon[28128]: osdmap e57: 8 total, 8 up, 8 in 2024-09-10T23:02:15.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:15 smithi046 ceph-mon[28128]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:15.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:15 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool create", "pool": "cephfs.bar.meta"} : dispatch 2024-09-10T23:02:15.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:15 smithi073 ceph-mon[35473]: osdmap e57: 8 total, 8 up, 8 in 2024-09-10T23:02:15.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:15 smithi073 ceph-mon[35473]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:02:15.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:15 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pool create", "pool": "cephfs.bar.meta"} : dispatch 2024-09-10T23:02:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:16 smithi073 ceph-mon[35473]: pgmap v247: 65 pgs: 32 active+clean, 5 creating+peering, 28 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2024-09-10T23:02:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:16 smithi073 ceph-mon[35473]: osdmap e58: 8 total, 8 up, 8 in 2024-09-10T23:02:16.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"} : dispatch 2024-09-10T23:02:16.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:16 smithi046 ceph-mon[28128]: pgmap v247: 65 pgs: 32 active+clean, 5 creating+peering, 28 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:16.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2024-09-10T23:02:16.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:16 smithi046 ceph-mon[28128]: osdmap e58: 8 total, 8 up, 8 in 2024-09-10T23:02:16.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"} : dispatch 2024-09-10T23:02:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.178+0000 7f7628c00640 1 -- 172.21.15.46:0/3574929124 <== mgr.14227 v2:172.21.15.46:6800/3534556395 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f762c063590 con 0x7f761007a370 2024-09-10T23:02:17.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.182+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f761007a370 msgr2=0x7f761007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:17.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.182+0000 7f7632800640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f761007a370 0x7f761007c830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f761c005fd0 tx=0x7f761c005850 comp rx=0 tx=0).stop 2024-09-10T23:02:17.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.182+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 msgr2=0x7f762c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:17.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.182+0000 7f7632800640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 0x7f762c19ab50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f76140099a0 tx=0x7f7614004040 comp rx=0 tx=0).stop 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.183+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 shutdown_connections 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.183+0000 7f7632800640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f761007a370 0x7f761007c830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.183+0000 7f7632800640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f762c076f80 0x7f762c19ab50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.183+0000 7f7632800640 1 --2- 172.21.15.46:0/3574929124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c075b20 0x7f762c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.183+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 >> 172.21.15.46:0/3574929124 conn(0x7f762c0fe0a0 msgr2=0x7f762c1088e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.184+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 shutdown_connections 2024-09-10T23:02:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:17.184+0000 7f7632800640 1 -- 172.21.15.46:0/3574929124 wait complete. 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046[28124]: 2024-09-10T23:02:17.161+0000 7f4648800640 -1 log_channel(cluster) log [ERR] : Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: osdmap e59: 8 total, 8 up, 8 in 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"} : dispatch 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: osdmap e60: 8 total, 8 up, 8 in 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.smithi073.nheemt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:17.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi073.nheemt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:17.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:17.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:17 smithi046 ceph-mon[28128]: Deploying daemon mds.foo.smithi073.nheemt on smithi073 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: osdmap e59: 8 total, 8 up, 8 in 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"} : dispatch 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: osdmap e60: 8 total, 8 up, 8 in 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.561 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.562 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:17.562 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.smithi073.nheemt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:17.562 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi073.nheemt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:17.562 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:17.562 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:17 smithi073 ceph-mon[35473]: Deploying daemon mds.foo.smithi073.nheemt on smithi073 2024-09-10T23:02:18.039 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T23:02:18.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:02:18.441 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: pgmap v251: 129 pgs: 68 active+clean, 20 creating+peering, 41 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: Health check update: 2 filesystems are online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] up:boot 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: daemon mds.foo.smithi046.twlkrf assigned to filesystem foo as rank 0 (now has 1 ranks) 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: fsmap foo:0 bar:0 1 up:standby 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "foo.smithi046.twlkrf"} : dispatch 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: Saving service mds.bar spec with placement count:2 2024-09-10T23:02:18.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: fsmap foo:1 bar:0 {foo:0=foo.smithi046.twlkrf=up:creating} 2024-09-10T23:02:18.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:18.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: daemon mds.foo.smithi046.twlkrf is now active in filesystem foo as rank 0 2024-09-10T23:02:18.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:18 smithi046 ceph-mon[28128]: osdmap e61: 8 total, 8 up, 8 in 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: pgmap v251: 129 pgs: 68 active+clean, 20 creating+peering, 41 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: Health check update: 2 filesystems are online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] up:boot 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: daemon mds.foo.smithi046.twlkrf assigned to filesystem foo as rank 0 (now has 1 ranks) 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: fsmap foo:0 bar:0 1 up:standby 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "foo.smithi046.twlkrf"} : dispatch 2024-09-10T23:02:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: Saving service mds.bar spec with placement count:2 2024-09-10T23:02:18.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: fsmap foo:1 bar:0 {foo:0=foo.smithi046.twlkrf=up:creating} 2024-09-10T23:02:18.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:18.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: daemon mds.foo.smithi046.twlkrf is now active in filesystem foo as rank 0 2024-09-10T23:02:18.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:18 smithi073 ceph-mon[35473]: osdmap e61: 8 total, 8 up, 8 in 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.102+0000 7f68cf600640 1 -- 172.21.15.46:0/1916865279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c8101f10 msgr2=0x7f68c810ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.102+0000 7f68cf600640 1 --2- 172.21.15.46:0/1916865279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c8101f10 0x7f68c810ec60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009880 tx=0x7f68b402a530 comp rx=0 tx=0).stop 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.102+0000 7f68cf600640 1 -- 172.21.15.46:0/1916865279 shutdown_connections 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.102+0000 7f68cf600640 1 --2- 172.21.15.46:0/1916865279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c8101f10 0x7f68c810ec60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.102+0000 7f68cf600640 1 --2- 172.21.15.46:0/1916865279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c81015f0 0x7f68c81019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.103+0000 7f68cf600640 1 -- 172.21.15.46:0/1916865279 >> 172.21.15.46:0/1916865279 conn(0x7f68c80fd4e0 msgr2=0x7f68c80ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.103+0000 7f68cf600640 1 -- 172.21.15.46:0/1916865279 shutdown_connections 2024-09-10T23:02:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.103+0000 7f68cf600640 1 -- 172.21.15.46:0/1916865279 wait complete. 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68cf600640 1 Processor -- start 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68cf600640 1 -- start start 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68cf600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 0x7f68c819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68cf600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c8101f10 0x7f68c819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68cf600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8111d90 con 0x7f68c81015f0 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68cf600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8111c10 con 0x7f68c8101f10 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68ccc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 0x7f68c819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68ccc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 0x7f68c819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42418/0 (socket says 172.21.15.46:42418) 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68ccc00640 1 -- 172.21.15.46:0/3026206964 learned_addr learned my addr 172.21.15.46:0/3026206964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.104+0000 7f68c7e00640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c8101f10 0x7f68c819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68ccc00640 1 -- 172.21.15.46:0/3026206964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c8101f10 msgr2=0x7f68c819ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68ccc00640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c8101f10 0x7f68c819ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68ccc00640 1 -- 172.21.15.46:0/3026206964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c81a0230 con 0x7f68c81015f0 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68ccc00640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 0x7f68c819a950 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00e970 tx=0x7f68bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68bc00cac0 con 0x7f68c81015f0 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68bc0054b0 con 0x7f68c81015f0 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68bc004c40 con 0x7f68c81015f0 2024-09-10T23:02:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.105+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c81a0520 con 0x7f68c81015f0 2024-09-10T23:02:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.106+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c81a0b00 con 0x7f68c81015f0 2024-09-10T23:02:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.107+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c819b610 con 0x7f68c81015f0 2024-09-10T23:02:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.108+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f68bc00cc60 con 0x7f68c81015f0 2024-09-10T23:02:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.109+0000 7f68c5600640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f68b007a320 0x7f68b007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.109+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7f68bc09db50 con 0x7f68c81015f0 2024-09-10T23:02:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.109+0000 7f68c7e00640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f68b007a320 0x7f68b007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.110+0000 7f68c7e00640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f68b007a320 0x7f68b007c7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b40058d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.114+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f68c819b610 con 0x7f68c81015f0 2024-09-10T23:02:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.348+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68c810c340 con 0x7f68c81015f0 2024-09-10T23:02:19.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.348+0000 7f68c5600640 1 -- 172.21.15.46:0/3026206964 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+4059 (secure 0 0 0) 0x7f68bc064e90 con 0x7f68c81015f0 2024-09-10T23:02:19.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:19.350 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"btime":"2024-09-10T23:02:18:176251+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:12.132118+0000","modified":"2024-09-10T23:02:18.176248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"foo.smithi046.twlkrf","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.46:6835/1804766534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1804766534},{"type":"v1","addr":"172.21.15.46:6835","nonce":1804766534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14622,"qdb_cluster":[14622]},"id":1},{"mdsmap":{"epoch":3,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:16.166322+0000","modified":"2024-09-10T23:02:16.166322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-10T23:02:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2024-09-10T23:02:19.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.350+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f68b007a320 msgr2=0x7f68b007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.350+0000 7f68cf600640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f68b007a320 0x7f68b007c7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b40058d0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.350+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 msgr2=0x7f68c819a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.350+0000 7f68cf600640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 0x7f68c819a950 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00e970 tx=0x7f68bc00ed70 comp rx=0 tx=0).stop 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 shutdown_connections 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f68b007a320 0x7f68b007c7e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c8101f10 0x7f68c819ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 --2- 172.21.15.46:0/3026206964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c81015f0 0x7f68c819a950 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 >> 172.21.15.46:0/3026206964 conn(0x7f68c80fd4e0 msgr2=0x7f68c80fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 shutdown_connections 2024-09-10T23:02:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:19.351+0000 7f68cf600640 1 -- 172.21.15.46:0/3026206964 wait complete. 2024-09-10T23:02:19.366 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:19 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] up:active 2024-09-10T23:02:19.366 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:19 smithi046 ceph-mon[28128]: fsmap foo:1 bar:0 {foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:19.366 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:19 smithi046 ceph-mon[28128]: osdmap e62: 8 total, 8 up, 8 in 2024-09-10T23:02:19.528 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:19 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] up:active 2024-09-10T23:02:19.528 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:19 smithi073 ceph-mon[35473]: fsmap foo:1 bar:0 {foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:19.528 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:19 smithi073 ceph-mon[35473]: osdmap e62: 8 total, 8 up, 8 in 2024-09-10T23:02:20.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:02:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:20 smithi046 ceph-mon[28128]: pgmap v254: 129 pgs: 74 active+clean, 20 creating+peering, 35 unknown; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 3 op/s 2024-09-10T23:02:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:20 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3026206964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:20.574 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:20.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:20 smithi073 ceph-mon[35473]: pgmap v254: 129 pgs: 74 active+clean, 20 creating+peering, 35 unknown; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 3 op/s 2024-09-10T23:02:20.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:20 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3026206964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:21.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 -- 172.21.15.46:0/162361756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14103a60 msgr2=0x7faf14103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:21.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 --2- 172.21.15.46:0/162361756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14103a60 0x7faf14103e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf04009880 tx=0x7faf0402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 -- 172.21.15.46:0/162361756 shutdown_connections 2024-09-10T23:02:21.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 --2- 172.21.15.46:0/162361756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf14104380 0x7faf1410c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 --2- 172.21.15.46:0/162361756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14103a60 0x7faf14103e40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 -- 172.21.15.46:0/162361756 >> 172.21.15.46:0/162361756 conn(0x7faf140fd4e0 msgr2=0x7faf140ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:21.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 -- 172.21.15.46:0/162361756 shutdown_connections 2024-09-10T23:02:21.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.100+0000 7faf1b200640 1 -- 172.21.15.46:0/162361756 wait complete. 2024-09-10T23:02:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.101+0000 7faf1b200640 1 Processor -- start 2024-09-10T23:02:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.101+0000 7faf1b200640 1 -- start start 2024-09-10T23:02:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf1b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf14103a60 0x7faf1419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf1b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 0x7faf1419b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf1b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf1410fc20 con 0x7faf14104380 2024-09-10T23:02:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf1b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faf1410faa0 con 0x7faf14103a60 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf13400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 0x7faf1419b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf13e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf14103a60 0x7faf1419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf13400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 0x7faf1419b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42436/0 (socket says 172.21.15.46:42436) 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.102+0000 7faf13400640 1 -- 172.21.15.46:0/1428708245 learned_addr learned my addr 172.21.15.46:0/1428708245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf13400640 1 -- 172.21.15.46:0/1428708245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf14103a60 msgr2=0x7faf1419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf13400640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf14103a60 0x7faf1419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf13400640 1 -- 172.21.15.46:0/1428708245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf141a03b0 con 0x7faf14104380 2024-09-10T23:02:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf13400640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 0x7faf1419b010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf0000b340 tx=0x7faf0000b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf00015020 con 0x7faf14104380 2024-09-10T23:02:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf00011ac0 con 0x7faf14104380 2024-09-10T23:02:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf00010af0 con 0x7faf14104380 2024-09-10T23:02:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.103+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf141a06a0 con 0x7faf14104380 2024-09-10T23:02:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.104+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf141a0cb0 con 0x7faf14104380 2024-09-10T23:02:21.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.105+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1419b790 con 0x7faf14104380 2024-09-10T23:02:21.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.106+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7faf00010cb0 con 0x7faf14104380 2024-09-10T23:02:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.107+0000 7faf10c00640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faef807a370 0x7faef807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.108+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7faf0009cff0 con 0x7faf14104380 2024-09-10T23:02:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.108+0000 7faf13e00640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faef807a370 0x7faef807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:21.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.108+0000 7faf13e00640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faef807a370 0x7faef807c830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faf04000c00 tx=0x7faf04005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:21.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.112+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faf1419b790 con 0x7faf14104380 2024-09-10T23:02:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.390+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf1406b660 con 0x7faf14104380 2024-09-10T23:02:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.391+0000 7faf10c00640 1 -- 172.21.15.46:0/1428708245 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4918 (secure 0 0 0) 0x7faf0001f020 con 0x7faf14104380 2024-09-10T23:02:21.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:21.393 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"btime":"2024-09-10T23:02:21:184451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:12.132118+0000","modified":"2024-09-10T23:02:18.176248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"foo.smithi046.twlkrf","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.46:6835/1804766534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1804766534},{"type":"v1","addr":"172.21.15.46:6835","nonce":1804766534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14622,"qdb_cluster":[14622]},"id":1},{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:16.166322+0000","modified":"2024-09-10T23:02:21.184438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24415":{"gid":24415,"name":"foo.smithi073.nheemt","rank":0,"incarnation":7,"state":"up:creating","state_seq":1,"addr":"172.21.15.73:6833/2343722155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2343722155},{"type":"v1","addr":"172.21.15.73:6833","nonce":2343722155}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-10T23:02:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-09-10T23:02:21.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faef807a370 msgr2=0x7faef807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:21.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faef807a370 0x7faef807c830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faf04000c00 tx=0x7faf04005a20 comp rx=0 tx=0).stop 2024-09-10T23:02:21.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 msgr2=0x7faf1419b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:21.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 0x7faf1419b010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf0000b340 tx=0x7faf0000b800 comp rx=0 tx=0).stop 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 shutdown_connections 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7faef807a370 0x7faef807c830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf14104380 0x7faf1419b010 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 --2- 172.21.15.46:0/1428708245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf14103a60 0x7faf1419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.393+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 >> 172.21.15.46:0/1428708245 conn(0x7faf140fd4e0 msgr2=0x7faf14101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.394+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 shutdown_connections 2024-09-10T23:02:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:21.394+0000 7faf1b200640 1 -- 172.21.15.46:0/1428708245 wait complete. 2024-09-10T23:02:21.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.73:6832/2343722155,v1:172.21.15.73:6833/2343722155] up:boot 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: daemon mds.foo.smithi073.nheemt assigned to filesystem bar as rank 0 (now has 1 ranks) 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:02:21.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: fsmap foo:1 bar:0 {foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:21.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "foo.smithi073.nheemt"} : dispatch 2024-09-10T23:02:21.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1 {bar:0=foo.smithi073.nheemt=up:creating,foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:21.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:21 smithi046 ceph-mon[28128]: daemon mds.foo.smithi073.nheemt is now active in filesystem bar as rank 0 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.73:6832/2343722155,v1:172.21.15.73:6833/2343722155] up:boot 2024-09-10T23:02:21.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: daemon mds.foo.smithi073.nheemt assigned to filesystem bar as rank 0 (now has 1 ranks) 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: fsmap foo:1 bar:0 {foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "foo.smithi073.nheemt"} : dispatch 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1 {bar:0=foo.smithi073.nheemt=up:creating,foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:21.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:21 smithi073 ceph-mon[35473]: daemon mds.foo.smithi073.nheemt is now active in filesystem bar as rank 0 2024-09-10T23:02:22.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:22 smithi046 ceph-mon[28128]: pgmap v255: 129 pgs: 126 active+clean, 3 creating+peering; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:02:22.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:22.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:22 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1428708245' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:22.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:22 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] up:active 2024-09-10T23:02:22.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:22 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.73:6832/2343722155,v1:172.21.15.73:6833/2343722155] up:active 2024-09-10T23:02:22.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:22 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1 {bar:0=foo.smithi073.nheemt=up:active,foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:22.686 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:22 smithi073 ceph-mon[35473]: pgmap v255: 129 pgs: 126 active+clean, 3 creating+peering; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:02:22.686 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:22.686 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:22 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1428708245' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:22.686 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:22 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] up:active 2024-09-10T23:02:22.686 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:22 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.73:6832/2343722155,v1:172.21.15.73:6833/2343722155] up:active 2024-09-10T23:02:22.686 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:22 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1 {bar:0=foo.smithi073.nheemt=up:active,foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:22.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:02:23.836 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:24.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:24 smithi046 ceph-mon[28128]: pgmap v256: 129 pgs: 129 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:02:24.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:24.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:24.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 -- 172.21.15.46:0/4162786925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 msgr2=0x7f7694104f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 --2- 172.21.15.46:0/4162786925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f7694104f60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7688009880 tx=0x7f768802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 -- 172.21.15.46:0/4162786925 shutdown_connections 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 --2- 172.21.15.46:0/4162786925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769410a590 0x7f769410a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 --2- 172.21.15.46:0/4162786925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f7694104f60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 -- 172.21.15.46:0/4162786925 >> 172.21.15.46:0/4162786925 conn(0x7f76941005f0 msgr2=0x7f7694102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 -- 172.21.15.46:0/4162786925 shutdown_connections 2024-09-10T23:02:24.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.686+0000 7f769b200640 1 -- 172.21.15.46:0/4162786925 wait complete. 2024-09-10T23:02:24.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f769b200640 1 Processor -- start 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f769b200640 1 -- start start 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f769b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f769419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f769b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769410a590 0x7f769419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f769b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7694111bb0 con 0x7f7694104b80 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f769b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7694111a30 con 0x7f769410a590 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f7699e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f769419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.687+0000 7f7699e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f769419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45490/0 (socket says 172.21.15.46:45490) 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f7699e00640 1 -- 172.21.15.46:0/3445017886 learned_addr learned my addr 172.21.15.46:0/3445017886 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f7699e00640 1 -- 172.21.15.46:0/3445017886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769410a590 msgr2=0x7f769419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:24.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f7699e00640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769410a590 0x7f769419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f7699e00640 1 -- 172.21.15.46:0/3445017886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76941a0050 con 0x7f7694104b80 2024-09-10T23:02:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f7699e00640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f769419a770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7688006010 tx=0x7f76880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f768803f070 con 0x7f7694104b80 2024-09-10T23:02:24.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76880049d0 con 0x7f7694104b80 2024-09-10T23:02:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76941a02e0 con 0x7f7694104b80 2024-09-10T23:02:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.688+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7688035030 con 0x7f7694104b80 2024-09-10T23:02:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.689+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76941a0890 con 0x7f7694104b80 2024-09-10T23:02:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.690+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769419b430 con 0x7f7694104b80 2024-09-10T23:02:24.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.691+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f7688003b10 con 0x7f7694104b80 2024-09-10T23:02:24.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.692+0000 7f768ea00640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f767c07a370 0x7f767c07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:24.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.692+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7f76880be370 con 0x7f7694104b80 2024-09-10T23:02:24.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.692+0000 7f7699400640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f767c07a370 0x7f767c07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:24.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.692+0000 7f7699400640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f767c07a370 0x7f767c07c830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7694109dc0 tx=0x7f7684005c70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:24.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.696+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f769419b430 con 0x7f7694104b80 2024-09-10T23:02:24.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:24 smithi073 ceph-mon[35473]: pgmap v256: 129 pgs: 129 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:02:24.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:24.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:24.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.896+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f769410cd30 con 0x7f7694104b80 2024-09-10T23:02:24.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.898+0000 7f768ea00640 1 -- 172.21.15.46:0/3445017886 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+21309 (secure 0 0 0) 0x7f7688085730 con 0x7f7694104b80 2024-09-10T23:02:24.900 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:24.900 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":62,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","created":"2024-09-10T22:53:11.794585+0000","modified":"2024-09-10T23:02:18.350481+0000","last_up_change":"2024-09-10T23:01:13.959042+0000","last_in_change":"2024-09-10T23:00:49.264739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:58:33.387526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-09-10T23:02:10.466793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-09-10T23:02:11.134933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-09-10T23:02:14.275939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-09-10T23:02:15.176313+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5460ef41-5ff6-4583-8410-9f83bcd495f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6803","nonce":2885579696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6805","nonce":2885579696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6809","nonce":2885579696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6807","nonce":2885579696}]},"public_addr":"172.21.15.46:6803/2885579696","cluster_addr":"172.21.15.46:6805/2885579696","heartbeat_back_addr":"172.21.15.46:6809/2885579696","heartbeat_front_addr":"172.21.15.46:6807/2885579696","state":["exists","up"]},{"osd":1,"uuid":"294d3916-f4c1-42a6-bfd4-7430ca8b8c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6811","nonce":3611441892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6813","nonce":3611441892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6817","nonce":3611441892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6815","nonce":3611441892}]},"public_addr":"172.21.15.46:6811/3611441892","cluster_addr":"172.21.15.46:6813/3611441892","heartbeat_back_addr":"172.21.15.46:6817/3611441892","heartbeat_front_addr":"172.21.15.46:6815/3611441892","state":["exists","up"]},{"osd":2,"uuid":"7cfa1ba4-f5c8-4efc-b923-73a99fad468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6819","nonce":3774780724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6821","nonce":3774780724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6825","nonce":3774780724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6823","nonce":3774780724}]},"public_addr":"172.21.15.46:6819/3774780724","cluster_addr":"172.21.15.46:6821/3774780724","heartbeat_back_addr":"172.21.15.46:6825/3774780724","heartbeat_front_addr":"172.21.15.46:6823/3774780724","state":["exists","up"]},{"osd":3,"uuid":"8575c985-20a6-4edb-8186-e502888ef174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6827","nonce":1627285252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6829","nonce":1627285252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6833","nonce":1627285252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6831","nonce":1627285252}]},"public_addr":"172.21.15.46:6827/1627285252","cluster_addr":"172.21.15.46:6829/1627285252","heartbeat_back_addr":"172.21.15.46:6833/1627285252","heartbeat_front_addr":"172.21.15.46:6831/1627285252","state":["exists","up"]},{"osd":4,"uuid":"5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6801","nonce":4123471774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6803","nonce":4123471774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6807","nonce":4123471774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6805","nonce":4123471774}]},"public_addr":"172.21.15.73:6801/4123471774","cluster_addr":"172.21.15.73:6803/4123471774","heartbeat_back_addr":"172.21.15.73:6807/4123471774","heartbeat_front_addr":"172.21.15.73:6805/4123471774","state":["exists","up"]},{"osd":5,"uuid":"84431538-dde7-43ca-94c2-ec8a3ce72421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6809","nonce":3681064684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6811","nonce":3681064684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6815","nonce":3681064684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6813","nonce":3681064684}]},"public_addr":"172.21.15.73:6809/3681064684","cluster_addr":"172.21.15.73:6811/3681064684","heartbeat_back_addr":"172.21.15.73:6815/3681064684","heartbeat_front_addr":"172.21.15.73:6813/3681064684","state":["exists","up"]},{"osd":6,"uuid":"c5725994-7afe-4abf-b961-99b13c47a55b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6817","nonce":2364854184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6819","nonce":2364854184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6823","nonce":2364854184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6821","nonce":2364854184}]},"public_addr":"172.21.15.73:6817/2364854184","cluster_addr":"172.21.15.73:6819/2364854184","heartbeat_back_addr":"172.21.15.73:6823/2364854184","heartbeat_front_addr":"172.21.15.73:6821/2364854184","state":["exists","up"]},{"osd":7,"uuid":"44eb7536-2797-402a-8041-e0b97cac2cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6825","nonce":1690062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6827","nonce":1690062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6831","nonce":1690062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6829","nonce":1690062257}]},"public_addr":"172.21.15.73:6825/1690062257","cluster_addr":"172.21.15.73:6827/1690062257","heartbeat_back_addr":"172.21.15.73:6831/1690062257","heartbeat_front_addr":"172.21.15.73:6829/1690062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:23.184934+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:57.854549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:58:30.670491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:02.736727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:33.037689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:06.105862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:39.985408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:01:12.056861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3052523989":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6801/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/2163720030":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/220137103":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/3240682838":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/263522480":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/1989006756":"2024-09-11T22:53:39.482819+0000","172.21.15.46:6800/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6800/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6800/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/1231598076":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/1514329312":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/2623235150":"2024-09-11T22:55:30.890832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:02:24.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f767c07a370 msgr2=0x7f767c07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:24.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f767c07a370 0x7f767c07c830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7694109dc0 tx=0x7f7684005c70 comp rx=0 tx=0).stop 2024-09-10T23:02:24.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 msgr2=0x7f769419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f769419a770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7688006010 tx=0x7f76880045e0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 shutdown_connections 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f767c07a370 0x7f767c07c830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769410a590 0x7f769419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.900+0000 7f769b200640 1 --2- 172.21.15.46:0/3445017886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7694104b80 0x7f769419a770 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.901+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 >> 172.21.15.46:0/3445017886 conn(0x7f76941005f0 msgr2=0x7f76941010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.901+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 shutdown_connections 2024-09-10T23:02:24.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:24.901+0000 7f769b200640 1 -- 172.21.15.46:0/3445017886 wait complete. 2024-09-10T23:02:25.739 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:25 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/3445017886' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:02:25.776 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:02:12.132118+0000', 'modified': '2024-09-10T23:02:18.176248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'foo.smithi046.twlkrf', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.46:6835/1804766534', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6834', 'nonce': 1804766534}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1804766534}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 14622, 'qdb_cluster': [14622]} 2024-09-10T23:02:25.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:02:25.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell mds.foo.smithi046.twlkrf status 2024-09-10T23:02:25.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:25 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/3445017886' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:02:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:26.807 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:26 smithi046 ceph-mon[28128]: pgmap v257: 129 pgs: 129 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s wr, 7 op/s 2024-09-10T23:02:26.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:26 smithi073 ceph-mon[35473]: pgmap v257: 129 pgs: 129 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s wr, 7 op/s 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 -- 172.21.15.46:0/1100490647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1083b0 msgr2=0x7fa56c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 --2- 172.21.15.46:0/1100490647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1083b0 0x7fa56c1087f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa558009880 tx=0x7fa55802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 -- 172.21.15.46:0/1100490647 shutdown_connections 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 --2- 172.21.15.46:0/1100490647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1083b0 0x7fa56c1087f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 --2- 172.21.15.46:0/1100490647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa56c1029a0 0x7fa56c102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 -- 172.21.15.46:0/1100490647 >> 172.21.15.46:0/1100490647 conn(0x7fa56c0fe3f0 msgr2=0x7fa56c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:27.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 -- 172.21.15.46:0/1100490647 shutdown_connections 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.054+0000 7fa570e00640 1 -- 172.21.15.46:0/1100490647 wait complete. 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.055+0000 7fa570e00640 1 Processor -- start 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.055+0000 7fa570e00640 1 -- start start 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.055+0000 7fa570e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 0x7fa56c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.055+0000 7fa570e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa56c1083b0 0x7fa56c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.055+0000 7fa570e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c10f9f0 con 0x7fa56c1029a0 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.055+0000 7fa570e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c10f870 con 0x7fa56c1083b0 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 0x7fa56c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 0x7fa56c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45506/0 (socket says 172.21.15.46:45506) 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56b400640 1 -- 172.21.15.46:0/784741304 learned_addr learned my addr 172.21.15.46:0/784741304 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56aa00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa56c1083b0 0x7fa56c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56b400640 1 -- 172.21.15.46:0/784741304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa56c1083b0 msgr2=0x7fa56c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56b400640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa56c1083b0 0x7fa56c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.056+0000 7fa56b400640 1 -- 172.21.15.46:0/784741304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c075f20 con 0x7fa56c1029a0 2024-09-10T23:02:27.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.057+0000 7fa56b400640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 0x7fa56c0754a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d6f0 tx=0x7fa55c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:27.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.057+0000 7fa563e00640 1 -- 172.21.15.46:0/784741304 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa55c017070 con 0x7fa56c1029a0 2024-09-10T23:02:27.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.057+0000 7fa563e00640 1 -- 172.21.15.46:0/784741304 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa55c00de00 con 0x7fa56c1029a0 2024-09-10T23:02:27.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.057+0000 7fa563e00640 1 -- 172.21.15.46:0/784741304 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa55c0049d0 con 0x7fa56c1029a0 2024-09-10T23:02:27.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.057+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c076210 con 0x7fa56c1029a0 2024-09-10T23:02:27.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.057+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c1a4920 con 0x7fa56c1029a0 2024-09-10T23:02:27.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.060+0000 7fa563e00640 1 -- 172.21.15.46:0/784741304 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fa55c004c80 con 0x7fa56c1029a0 2024-09-10T23:02:27.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.060+0000 7fa574eaa740 1 Processor -- start 2024-09-10T23:02:27.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.060+0000 7fa574eaa740 1 -- start start 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d09720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa574eaa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f72c80e00 con 0x557f72d09c60 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa574eaa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557f72c70230 con 0x557f72d09340 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa563e00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa55007a370 0x7fa55007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa56be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d09720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d156b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45518/0 (socket says 172.21.15.46:45518) 2024-09-10T23:02:27.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa56b400640 1 -- 172.21.15.46:0/3429782509 learned_addr learned my addr 172.21.15.46:0/3429782509 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:27.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa563e00640 1 -- 172.21.15.46:0/784741304 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7fa55c09d150 con 0x7fa56c1029a0 2024-09-10T23:02:27.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.061+0000 7fa56aa00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa55007a370 0x7fa55007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa56be00640 1 -- 172.21.15.46:0/3429782509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 msgr2=0x557f72d156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa56be00640 1 --2- 172.21.15.46:0/3429782509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa56be00640 1 -- 172.21.15.46:0/3429782509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f72c3ab20 con 0x557f72d09340 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa56b400640 1 --2- 172.21.15.46:0/3429782509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa56be00640 1 --2- 172.21.15.46:0/3429782509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d09720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa564009d40 tx=0x7fa56400b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865e69e2277b96b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa56aa00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa55007a370 0x7fa55007c830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa56c076f90 tx=0x7fa5580095f0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa560c00640 1 -- 172.21.15.46:0/3429782509 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa564018070 con 0x557f72d09340 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa560c00640 1 -- 172.21.15.46:0/3429782509 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5640119b0 con 0x557f72d09340 2024-09-10T23:02:27.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.062+0000 7fa560c00640 1 -- 172.21.15.46:0/3429782509 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa564013a60 con 0x557f72d09340 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 -- 172.21.15.46:0/3429782509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 msgr2=0x557f72d09720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3429782509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d09720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa564009d40 tx=0x7fa56400b7c0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 -- 172.21.15.46:0/3429782509 shutdown_connections 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3429782509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3429782509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d09720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 -- 172.21.15.46:0/3429782509 >> 172.21.15.46:0/3429782509 conn(0x557f72d07120 msgr2=0x557f72d08310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 -- 172.21.15.46:0/3429782509 shutdown_connections 2024-09-10T23:02:27.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.063+0000 7fa574eaa740 1 -- 172.21.15.46:0/3429782509 wait complete. 2024-09-10T23:02:27.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.064+0000 7fa574eaa740 1 -- start start 2024-09-10T23:02:27.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.064+0000 7fa574eaa740 1 Processor -- start 2024-09-10T23:02:27.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.064+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d16080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d165c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa574eaa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f72c0b510 con 0x557f72d09340 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa574eaa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557f72c74040 con 0x557f72d09c60 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa574eaa740 10 client.0 _ll_register_callbacks cb 0x557f72c1b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d16080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d16080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45522/0 (socket says 172.21.15.46:45522) 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 -- 172.21.15.46:0/3183853241 learned_addr learned my addr 172.21.15.46:0/3183853241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56aa00640 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d165c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 -- 172.21.15.46:0/3183853241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 msgr2=0x557f72d165c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d165c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 -- 172.21.15.46:0/3183853241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f729ce6b0 con 0x557f72d09340 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa56b400640 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d16080 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa55c063b10 tx=0x7fa55c09d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cdd0189efe1c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.065+0000 7fa555600640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa555600640 1 -- 172.21.15.46:0/3183853241 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa55c020050 con 0x557f72d09340 2024-09-10T23:02:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa555600640 1 -- 172.21.15.46:0/3183853241 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7fa55c0051d0 con 0x557f72d09340 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f72c0db20 con 0x557f72d09340 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa555600640 1 -- 172.21.15.46:0/3183853241 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa55c05e0e0 con 0x557f72d09340 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa574eaa740 10 client.14646 fetch_fsmap learned FSMap version 8 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) -- 0x557f72c287a0 con 0x557f72d09340 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa555600640 1 -- 172.21.15.46:0/3183853241 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557f72c0db20 con 0x557f72d09340 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa555600640 1 -- 172.21.15.46:0/3183853241 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) ==== 2968+0+0 (secure 0 0 0) 0x7fa55c0696c0 con 0x557f72d09340 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa574eaa740 10 client.14646 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.066+0000 7fa574eaa740 10 client.14646 resolve_mds: resolved name 'foo.smithi046.twlkrf' to daemon mds.foo.smithi046.twlkrf 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa574eaa740 20 client.14646 populate_metadata read hostname 'smithi046' 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d231b0 0x557f72d255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa574eaa740 4 client.14646 mds_command: new command op to 14622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 --> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f72c82d50 con 0x557f72d231b0 2024-09-10T23:02:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa56aa00640 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d231b0 0x557f72d255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa56aa00640 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d231b0 0x557f72d255a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a9d71f6e30c698 server_cookie=a48e5508e6aaa3f0 in_seq=0 out_seq=0 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.067+0000 7fa555600640 10 client.14646 ms_handle_connect on v2:172.21.15.46:6834/1804766534 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa555600640 1 -- 172.21.15.46:0/3183853241 <== mds.0 v2:172.21.15.46:6834/1804766534 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f72c82d50 con 0x557f72d231b0 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa555600640 10 client.14646 handle_command_reply: tid=0 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 client.14646 shutdown 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 msgr2=0x557f72d16080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d16080 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa55c063b10 tx=0x7fa55c09d0b0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 shutdown_connections 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d231b0 0x557f72d255a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 --2- 172.21.15.46:0/3183853241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d16080 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.068+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 >> 172.21.15.46:0/3183853241 conn(0x557f72d07120 msgr2=0x557f72d06400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:27.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.069+0000 7fa555600640 0 client.14646 ms_handle_reset on v2:172.21.15.46:6834/1804766534 2024-09-10T23:02:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.069+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 shutdown_connections 2024-09-10T23:02:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.069+0000 7fa574eaa740 1 -- 172.21.15.46:0/3183853241 wait complete. 2024-09-10T23:02:27.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.069+0000 7fa574eaa740 20 client.14646 trim_cache size 0 max 16384 2024-09-10T23:02:27.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa574eaa740 1 Processor -- start 2024-09-10T23:02:27.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa574eaa740 1 -- start start 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d12830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa574eaa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1ab780 con 0x557f72d09340 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa574eaa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1ac780 con 0x557f72d09c60 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.088+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45526/0 (socket says 172.21.15.46:45526) 2024-09-10T23:02:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56b400640 1 -- 172.21.15.46:0/2448441840 learned_addr learned my addr 172.21.15.46:0/2448441840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56aa00640 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d12830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56b400640 1 -- 172.21.15.46:0/2448441840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 msgr2=0x557f72d12830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56b400640 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d12830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56b400640 1 -- 172.21.15.46:0/2448441840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f729ce6b0 con 0x557f72d09340 2024-09-10T23:02:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.089+0000 7fa56aa00640 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d12830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:02:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.090+0000 7fa56b400640 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d122f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa55c004770 tx=0x7fa55c060460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55852ea65f600df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:27.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.090+0000 7fa557e00640 1 -- 172.21.15.46:0/2448441840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa55c020070 con 0x557f72d09340 2024-09-10T23:02:27.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.090+0000 7fa557e00640 1 -- 172.21.15.46:0/2448441840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa55c07e070 con 0x557f72d09340 2024-09-10T23:02:27.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.090+0000 7fa557e00640 1 -- 172.21.15.46:0/2448441840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa55c063280 con 0x557f72d09340 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 -- 172.21.15.46:0/2448441840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 msgr2=0x557f72d122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d122f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa55c004770 tx=0x7fa55c060460 comp rx=0 tx=0).stop 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 -- 172.21.15.46:0/2448441840 shutdown_connections 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09c60 0x557f72d12830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 --2- 172.21.15.46:0/2448441840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09340 0x557f72d122f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 -- 172.21.15.46:0/2448441840 >> 172.21.15.46:0/2448441840 conn(0x557f72d07120 msgr2=0x557f72d16080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 -- 172.21.15.46:0/2448441840 shutdown_connections 2024-09-10T23:02:27.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.091+0000 7fa574eaa740 1 -- 172.21.15.46:0/2448441840 wait complete. 2024-09-10T23:02:27.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.092+0000 7fa574eaa740 1 -- start start 2024-09-10T23:02:27.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.092+0000 7fa574eaa740 1 Processor -- start 2024-09-10T23:02:27.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.092+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d1c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.092+0000 7fa574eaa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa574eaa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f72d21980 con 0x557f72d09c60 2024-09-10T23:02:27.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa574eaa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557f72ad1760 con 0x557f72d09340 2024-09-10T23:02:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa574eaa740 10 client.0 _ll_register_callbacks cb 0x7fa55c0688f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:02:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d1c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d1c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56090/0 (socket says 172.21.15.46:56090) 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56b400640 1 -- 172.21.15.46:0/867631817 learned_addr learned my addr 172.21.15.46:0/867631817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45528/0 (socket says 172.21.15.46:45528) 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56b400640 1 -- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 msgr2=0x557f72d186a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56b400640 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d186a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56b400640 1 -- 172.21.15.46:0/867631817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f72d157f0 con 0x557f72d09340 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.093+0000 7fa56aa00640 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:02:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa56b400640 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d1c170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa55c060390 tx=0x7fa55c09b360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da9139f47ea64edc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa555600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa555600640 1 -- 172.21.15.46:0/867631817 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa55c082020 con 0x557f72d09340 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa55c07e070 con 0x557f72d09340 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa555600640 1 -- 172.21.15.46:0/867631817 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7fa55c069580 con 0x557f72d09340 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa555600640 1 -- 172.21.15.46:0/867631817 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa55c020030 con 0x557f72d09340 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa574eaa740 10 client.24429 fetch_fsmap learned FSMap version 8 2024-09-10T23:02:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.094+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) -- 0x557f72d8ffc0 con 0x557f72d09340 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa555600640 1 -- 172.21.15.46:0/867631817 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa55c07e070 con 0x557f72d09340 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa555600640 1 -- 172.21.15.46:0/867631817 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) ==== 2968+0+0 (secure 0 0 0) 0x7fa55c009a30 con 0x557f72d09340 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa574eaa740 10 client.24429 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa574eaa740 10 client.24429 resolve_mds: resolved name 'foo.smithi046.twlkrf' to daemon mds.foo.smithi046.twlkrf 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa574eaa740 20 client.24429 populate_metadata read hostname 'smithi046' 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa574eaa740 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d90dc0 0x557f72d93210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa574eaa740 4 client.24429 mds_command: new command op to 14622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.095+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 --> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] -- command(tid 0: {"prefix": "status"}) -- 0x557f72c7e800 con 0x557f72d90dc0 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.096+0000 7fa56aa00640 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d90dc0 0x557f72d93210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.096+0000 7fa56aa00640 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d90dc0 0x557f72d93210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06173f05a825722 server_cookie=9610df12030916ad in_seq=0 out_seq=0 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.096+0000 7fa555600640 10 client.24429 ms_handle_connect on v2:172.21.15.46:6834/1804766534 2024-09-10T23:02:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.096+0000 7fa555600640 1 -- 172.21.15.46:0/867631817 <== mds.0 v2:172.21.15.46:6834/1804766534 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x557f72c7e800 con 0x557f72d90dc0 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.096+0000 7fa555600640 10 client.24429 handle_command_reply: tid=0 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.096+0000 7fa574eaa740 1 client.24429 shutdown 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 msgr2=0x557f72d1c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d1c170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa55c060390 tx=0x7fa55c09b360 comp rx=0 tx=0).stop 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 shutdown_connections 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:6834/1804766534,v1:172.21.15.46:6835/1804766534] conn(0x557f72d90dc0 0x557f72d93210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f72d09c60 0x557f72d186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 --2- 172.21.15.46:0/867631817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f72d09340 0x557f72d1c170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 >> 172.21.15.46:0/867631817 conn(0x557f72d07120 msgr2=0x557f72d05be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa555600640 0 client.24429 ms_handle_reset on v2:172.21.15.46:6834/1804766534 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 shutdown_connections 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 1 -- 172.21.15.46:0/867631817 wait complete. 2024-09-10T23:02:27.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.097+0000 7fa574eaa740 20 client.24429 trim_cache size 0 max 16384 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "52773b64-6fc7-11ef-bcea-c7b262605968", 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 14622, 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "foo", 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 9.9221307519999993, 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 8, 2024-09-10T23:02:27.102 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 62, 2024-09-10T23:02:27.102 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 62, 2024-09-10T23:02:27.102 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 10.596061075 2024-09-10T23:02:27.102 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-10T23:02:27.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa55007a370 msgr2=0x7fa55007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa55007a370 0x7fa55007c830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa56c076f90 tx=0x7fa5580095f0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 msgr2=0x7fa56c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 0x7fa56c0754a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d6f0 tx=0x7fa55c00dbb0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 shutdown_connections 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa55007a370 0x7fa55007c830 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa56c1083b0 0x7fa56c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 --2- 172.21.15.46:0/784741304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa56c1029a0 0x7fa56c0754a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.098+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 >> 172.21.15.46:0/784741304 conn(0x7fa56c0fe3f0 msgr2=0x7fa56c1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.099+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 shutdown_connections 2024-09-10T23:02:27.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:27.099+0000 7fa570e00640 1 -- 172.21.15.46:0/784741304 wait complete. 2024-09-10T23:02:28.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:02:28.716 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:28 smithi046 ceph-mon[28128]: pgmap v258: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s wr, 9 op/s 2024-09-10T23:02:28.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:28 smithi073 ceph-mon[35473]: pgmap v258: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s wr, 9 op/s 2024-09-10T23:02:29.097 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.632+0000 7efc7c600640 1 -- 172.21.15.46:0/822635548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 msgr2=0x7efc74109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.632+0000 7efc7c600640 1 --2- 172.21.15.46:0/822635548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc74109620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efc68009880 tx=0x7efc6802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.632+0000 7efc7c600640 1 -- 172.21.15.46:0/822635548 shutdown_connections 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.632+0000 7efc7c600640 1 --2- 172.21.15.46:0/822635548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc7410eaf0 0x7efc7410ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.632+0000 7efc7c600640 1 --2- 172.21.15.46:0/822635548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc74109620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.632+0000 7efc7c600640 1 -- 172.21.15.46:0/822635548 >> 172.21.15.46:0/822635548 conn(0x7efc74078780 msgr2=0x7efc7407aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.633+0000 7efc7c600640 1 -- 172.21.15.46:0/822635548 shutdown_connections 2024-09-10T23:02:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.633+0000 7efc7c600640 1 -- 172.21.15.46:0/822635548 wait complete. 2024-09-10T23:02:29.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.633+0000 7efc7c600640 1 Processor -- start 2024-09-10T23:02:29.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc7c600640 1 -- start start 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc7c600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc7419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc7c600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc7410eaf0 0x7efc7419f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc7c600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efc74116180 con 0x7efc74109240 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc7c600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efc74116000 con 0x7efc7410eaf0 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc79c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc7419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc79c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc7419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45552/0 (socket says 172.21.15.46:45552) 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc79c00640 1 -- 172.21.15.46:0/1817339409 learned_addr learned my addr 172.21.15.46:0/1817339409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.634+0000 7efc79200640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc7410eaf0 0x7efc7419f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc79c00640 1 -- 172.21.15.46:0/1817339409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc7410eaf0 msgr2=0x7efc7419f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc79c00640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc7410eaf0 0x7efc7419f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc79c00640 1 -- 172.21.15.46:0/1817339409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc741a4600 con 0x7efc74109240 2024-09-10T23:02:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc79c00640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc7419ed20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efc68006010 tx=0x7efc680045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc6803f070 con 0x7efc74109240 2024-09-10T23:02:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc680048d0 con 0x7efc74109240 2024-09-10T23:02:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc68035030 con 0x7efc74109240 2024-09-10T23:02:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.635+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741a4890 con 0x7efc74109240 2024-09-10T23:02:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.636+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc741a4e40 con 0x7efc74109240 2024-09-10T23:02:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.637+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7419f9e0 con 0x7efc74109240 2024-09-10T23:02:29.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.638+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7efc680035f0 con 0x7efc74109240 2024-09-10T23:02:29.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.639+0000 7efc72000640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efc5c07a320 0x7efc5c07c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:29.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.639+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 7138+0+0 (secure 0 0 0) 0x7efc680be230 con 0x7efc74109240 2024-09-10T23:02:29.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.639+0000 7efc79200640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efc5c07a320 0x7efc5c07c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:29.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.640+0000 7efc79200640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efc5c07a320 0x7efc5c07c7e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc7410c5e0 tx=0x7efc60005f90 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:29.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.644+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efc7419f9e0 con 0x7efc74109240 2024-09-10T23:02:29.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.894+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc741112a0 con 0x7efc74109240 2024-09-10T23:02:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.894+0000 7efc72000640 1 -- 172.21.15.46:0/1817339409 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4923 (secure 0 0 0) 0x7efc680899d0 con 0x7efc74109240 2024-09-10T23:02:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:29.896 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"btime":"2024-09-10T23:02:22:185832+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:12.132118+0000","modified":"2024-09-10T23:02:21.195967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"foo.smithi046.twlkrf","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1804766534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1804766534},{"type":"v1","addr":"172.21.15.46:6835","nonce":1804766534}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14622,"qdb_cluster":[14622]},"id":1},{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:16.166322+0000","modified":"2024-09-10T23:02:22.185827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24415":{"gid":24415,"name":"foo.smithi073.nheemt","rank":0,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6833/2343722155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2343722155},{"type":"v1","addr":"172.21.15.73:6833","nonce":2343722155}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24415,"qdb_cluster":[24415]},"id":2}]} 2024-09-10T23:02:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-09-10T23:02:29.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efc5c07a320 msgr2=0x7efc5c07c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:29.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efc5c07a320 0x7efc5c07c7e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc7410c5e0 tx=0x7efc60005f90 comp rx=0 tx=0).stop 2024-09-10T23:02:29.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 msgr2=0x7efc7419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc7419ed20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efc68006010 tx=0x7efc680045c0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 shutdown_connections 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7efc5c07a320 0x7efc5c07c7e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc7410eaf0 0x7efc7419f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 --2- 172.21.15.46:0/1817339409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc74109240 0x7efc7419ed20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 >> 172.21.15.46:0/1817339409 conn(0x7efc74078780 msgr2=0x7efc7407ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 shutdown_connections 2024-09-10T23:02:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:29.897+0000 7efc7c600640 1 -- 172.21.15.46:0/1817339409 wait complete. 2024-09-10T23:02:30.208 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:30.208 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.smithi046.pyflwx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi046.pyflwx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: Deploying daemon mds.bar.smithi046.pyflwx on smithi046 2024-09-10T23:02:30.209 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:29 smithi073 ceph-mon[35473]: pgmap v259: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-10T23:02:30.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:30.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:30.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.smithi046.pyflwx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi046.pyflwx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: Deploying daemon mds.bar.smithi046.pyflwx on smithi046 2024-09-10T23:02:30.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:29 smithi046 ceph-mon[28128]: pgmap v259: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-10T23:02:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:30 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1817339409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:31.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:02:31.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:30 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1817339409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]} : dispatch 2024-09-10T23:02:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]} : dispatch 2024-09-10T23:02:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]} : dispatch 2024-09-10T23:02:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]} : dispatch 2024-09-10T23:02:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: pgmap v260: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T23:02:32.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:32.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:32.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]} : dispatch 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]} : dispatch 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]} : dispatch 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]} : dispatch 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: pgmap v260: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:32.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:32.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.654+0000 7f5dc2a00640 1 -- 172.21.15.46:0/701633842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 msgr2=0x7f5dbc075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.654+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/701633842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 0x7f5dbc075920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009880 tx=0x7f5db002a4b0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.655+0000 7f5dc2a00640 1 -- 172.21.15.46:0/701633842 shutdown_connections 2024-09-10T23:02:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.655+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/701633842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.655+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/701633842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 0x7f5dbc075920 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.655+0000 7f5dc2a00640 1 -- 172.21.15.46:0/701633842 >> 172.21.15.46:0/701633842 conn(0x7f5dbc0fe3f0 msgr2=0x7f5dbc100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.655+0000 7f5dc2a00640 1 -- 172.21.15.46:0/701633842 shutdown_connections 2024-09-10T23:02:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.655+0000 7f5dc2a00640 1 -- 172.21.15.46:0/701633842 wait complete. 2024-09-10T23:02:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.656+0000 7f5dc2a00640 1 Processor -- start 2024-09-10T23:02:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc2a00640 1 -- start start 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 0x7f5dbc19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc19acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc2a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc111b30 con 0x7f5dbc075f40 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc2a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc1119b0 con 0x7f5dbc075540 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc19acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc19acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45578/0 (socket says 172.21.15.46:45578) 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.657+0000 7f5dc0c00640 1 -- 172.21.15.46:0/1580845166 learned_addr learned my addr 172.21.15.46:0/1580845166 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.658+0000 7f5dc1600640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 0x7f5dbc19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.658+0000 7f5dc0c00640 1 -- 172.21.15.46:0/1580845166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 msgr2=0x7f5dbc19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.658+0000 7f5dc0c00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 0x7f5dbc19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.658+0000 7f5dc0c00640 1 -- 172.21.15.46:0/1580845166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dbc1a0090 con 0x7f5dbc075f40 2024-09-10T23:02:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.658+0000 7f5dc0c00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc19acf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5da800e970 tx=0x7f5da800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:32.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.659+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5da800cac0 con 0x7f5dbc075f40 2024-09-10T23:02:32.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.659+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5da800cc60 con 0x7f5dbc075f40 2024-09-10T23:02:32.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.659+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5da8018650 con 0x7f5dbc075f40 2024-09-10T23:02:32.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.659+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dbc1a0380 con 0x7f5dbc075f40 2024-09-10T23:02:32.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.659+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dbc1a0910 con 0x7f5dbc075f40 2024-09-10T23:02:32.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.660+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dbc19b470 con 0x7f5dbc075f40 2024-09-10T23:02:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.662+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f5da8010430 con 0x7f5dbc075f40 2024-09-10T23:02:32.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.663+0000 7f5dba000640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5da407a370 0x7f5da407c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:32.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.663+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 7254+0+0 (secure 0 0 0) 0x7f5da809d900 con 0x7f5dbc075f40 2024-09-10T23:02:32.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.663+0000 7f5dc1600640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5da407a370 0x7f5da407c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:32.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.664+0000 7f5dc1600640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5da407a370 0x7f5da407c830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5db0000c00 tx=0x7f5db00058d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:32.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.671+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5dbc19b470 con 0x7f5dbc075f40 2024-09-10T23:02:32.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.876+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dbc10bfd0 con 0x7f5dbc075f40 2024-09-10T23:02:32.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.878+0000 7f5dba000640 1 -- 172.21.15.46:0/1580845166 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+21496 (secure 0 0 0) 0x7f5da80691f0 con 0x7f5dbc075f40 2024-09-10T23:02:32.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:32.879 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":63,"fsid":"52773b64-6fc7-11ef-bcea-c7b262605968","created":"2024-09-10T22:53:11.794585+0000","modified":"2024-09-10T23:02:31.877246+0000","last_up_change":"2024-09-10T23:01:13.959042+0000","last_in_change":"2024-09-10T23:00:49.264739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:58:33.387526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-09-10T23:02:10.466793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-09-10T23:02:11.134933+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-09-10T23:02:14.275939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-09-10T23:02:15.176313+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5460ef41-5ff6-4583-8410-9f83bcd495f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6803","nonce":2885579696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6805","nonce":2885579696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6809","nonce":2885579696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2885579696},{"type":"v1","addr":"172.21.15.46:6807","nonce":2885579696}]},"public_addr":"172.21.15.46:6803/2885579696","cluster_addr":"172.21.15.46:6805/2885579696","heartbeat_back_addr":"172.21.15.46:6809/2885579696","heartbeat_front_addr":"172.21.15.46:6807/2885579696","state":["exists","up"]},{"osd":1,"uuid":"294d3916-f4c1-42a6-bfd4-7430ca8b8c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6811","nonce":3611441892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6813","nonce":3611441892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6817","nonce":3611441892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3611441892},{"type":"v1","addr":"172.21.15.46:6815","nonce":3611441892}]},"public_addr":"172.21.15.46:6811/3611441892","cluster_addr":"172.21.15.46:6813/3611441892","heartbeat_back_addr":"172.21.15.46:6817/3611441892","heartbeat_front_addr":"172.21.15.46:6815/3611441892","state":["exists","up"]},{"osd":2,"uuid":"7cfa1ba4-f5c8-4efc-b923-73a99fad468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6819","nonce":3774780724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6821","nonce":3774780724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6825","nonce":3774780724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3774780724},{"type":"v1","addr":"172.21.15.46:6823","nonce":3774780724}]},"public_addr":"172.21.15.46:6819/3774780724","cluster_addr":"172.21.15.46:6821/3774780724","heartbeat_back_addr":"172.21.15.46:6825/3774780724","heartbeat_front_addr":"172.21.15.46:6823/3774780724","state":["exists","up"]},{"osd":3,"uuid":"8575c985-20a6-4edb-8186-e502888ef174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6827","nonce":1627285252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6829","nonce":1627285252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6833","nonce":1627285252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1627285252},{"type":"v1","addr":"172.21.15.46:6831","nonce":1627285252}]},"public_addr":"172.21.15.46:6827/1627285252","cluster_addr":"172.21.15.46:6829/1627285252","heartbeat_back_addr":"172.21.15.46:6833/1627285252","heartbeat_front_addr":"172.21.15.46:6831/1627285252","state":["exists","up"]},{"osd":4,"uuid":"5d0e16c2-3e3c-4a11-ae26-e4aa22c946ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6801","nonce":4123471774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6803","nonce":4123471774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6807","nonce":4123471774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4123471774},{"type":"v1","addr":"172.21.15.73:6805","nonce":4123471774}]},"public_addr":"172.21.15.73:6801/4123471774","cluster_addr":"172.21.15.73:6803/4123471774","heartbeat_back_addr":"172.21.15.73:6807/4123471774","heartbeat_front_addr":"172.21.15.73:6805/4123471774","state":["exists","up"]},{"osd":5,"uuid":"84431538-dde7-43ca-94c2-ec8a3ce72421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6809","nonce":3681064684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6811","nonce":3681064684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6815","nonce":3681064684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3681064684},{"type":"v1","addr":"172.21.15.73:6813","nonce":3681064684}]},"public_addr":"172.21.15.73:6809/3681064684","cluster_addr":"172.21.15.73:6811/3681064684","heartbeat_back_addr":"172.21.15.73:6815/3681064684","heartbeat_front_addr":"172.21.15.73:6813/3681064684","state":["exists","up"]},{"osd":6,"uuid":"c5725994-7afe-4abf-b961-99b13c47a55b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6817","nonce":2364854184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6819","nonce":2364854184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6823","nonce":2364854184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2364854184},{"type":"v1","addr":"172.21.15.73:6821","nonce":2364854184}]},"public_addr":"172.21.15.73:6817/2364854184","cluster_addr":"172.21.15.73:6819/2364854184","heartbeat_back_addr":"172.21.15.73:6823/2364854184","heartbeat_front_addr":"172.21.15.73:6821/2364854184","state":["exists","up"]},{"osd":7,"uuid":"44eb7536-2797-402a-8041-e0b97cac2cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6825","nonce":1690062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6827","nonce":1690062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6831","nonce":1690062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1690062257},{"type":"v1","addr":"172.21.15.73:6829","nonce":1690062257}]},"public_addr":"172.21.15.73:6825/1690062257","cluster_addr":"172.21.15.73:6827/1690062257","heartbeat_back_addr":"172.21.15.73:6831/1690062257","heartbeat_front_addr":"172.21.15.73:6829/1690062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:23.184934+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:57:57.854549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:58:30.670491+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:02.736727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:59:33.037689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:06.105862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:00:39.985408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:01:12.056861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3052523989":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6801/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/2163720030":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/220137103":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/3240682838":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/263522480":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/1989006756":"2024-09-11T22:53:39.482819+0000","172.21.15.46:6800/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/1963998222":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6800/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:6800/584006451":"2024-09-11T22:53:39.482819+0000","172.21.15.46:0/1231598076":"2024-09-11T22:54:15.921880+0000","172.21.15.46:6801/4066155340":"2024-09-11T22:55:30.890832+0000","172.21.15.46:0/1514329312":"2024-09-11T22:54:15.921880+0000","172.21.15.46:0/2623235150":"2024-09-11T22:55:30.890832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:02:32.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5da407a370 msgr2=0x7f5da407c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:32.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5da407a370 0x7f5da407c830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5db0000c00 tx=0x7f5db00058d0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 msgr2=0x7f5dbc19acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:32.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc19acf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5da800e970 tx=0x7f5da800ee30 comp rx=0 tx=0).stop 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 shutdown_connections 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f5da407a370 0x7f5da407c830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dbc075f40 0x7f5dbc19acf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 --2- 172.21.15.46:0/1580845166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dbc075540 0x7f5dbc19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.880+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 >> 172.21.15.46:0/1580845166 conn(0x7f5dbc0fe3f0 msgr2=0x7f5dbc1091a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.881+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 shutdown_connections 2024-09-10T23:02:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:32.881+0000 7f5dc2a00640 1 -- 172.21.15.46:0/1580845166 wait complete. 2024-09-10T23:02:32.980 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-09-10T23:02:32.981 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-09-10T23:02:32.981 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-10T23:02:32.981 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2024-09-10T23:02:32.981 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:32 smithi046 ceph-mon[28128]: osdmap e63: 8 total, 8 up, 8 in 2024-09-10T23:02:32.981 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:32 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1580845166' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:02:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-09-10T23:02:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-09-10T23:02:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-10T23:02:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2024-09-10T23:02:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:32 smithi073 ceph-mon[35473]: osdmap e63: 8 total, 8 up, 8 in 2024-09-10T23:02:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:32 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1580845166' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:02:33.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 3, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:02:16.166322+0000', 'modified': '2024-09-10T23:02:16.166322+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [], 'up': {}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:02:33.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-10T23:02:33.977 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:33 smithi046 ceph-mon[28128]: osdmap e64: 8 total, 8 up, 8 in 2024-09-10T23:02:33.977 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:33 smithi046 ceph-mon[28128]: pgmap v263: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 3 op/s 2024-09-10T23:02:34.230 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:33 smithi073 ceph-mon[35473]: osdmap e64: 8 total, 8 up, 8 in 2024-09-10T23:02:34.231 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:33 smithi073 ceph-mon[35473]: pgmap v263: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 3 op/s 2024-09-10T23:02:34.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:02:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.smithi073.rklcya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi073.rklcya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Deploying daemon mds.bar.smithi073.rklcya on smithi073 2024-09-10T23:02:35.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Cluster is now healthy 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:boot 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Dropping low affinity active daemon mds.foo.smithi073.nheemt in favor of higher affinity standby. 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Replacing daemon mds.foo.smithi073.nheemt as rank 0 with standby daemon mds.bar.smithi046.pyflwx 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1 {bar:0=foo.smithi073.nheemt=up:active,foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "bar.smithi046.pyflwx"} : dispatch 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: osdmap e65: 8 total, 8 up, 8 in 2024-09-10T23:02:35.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:35 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1/1 {bar:0=bar.smithi046.pyflwx=up:replay,foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:35.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:35.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:35.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:35.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.smithi073.rklcya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:02:35.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi073.rklcya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:02:35.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Deploying daemon mds.bar.smithi073.rklcya on smithi073 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Cluster is now healthy 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:boot 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Dropping low affinity active daemon mds.foo.smithi073.nheemt in favor of higher affinity standby. 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Replacing daemon mds.foo.smithi073.nheemt as rank 0 with standby daemon mds.bar.smithi046.pyflwx 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1 {bar:0=foo.smithi073.nheemt=up:active,foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "bar.smithi046.pyflwx"} : dispatch 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: osdmap e65: 8 total, 8 up, 8 in 2024-09-10T23:02:35.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:35 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1/1 {bar:0=bar.smithi046.pyflwx=up:replay,foo:0=foo.smithi046.twlkrf=up:active} 2024-09-10T23:02:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 -- 172.21.15.46:0/1628188137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075f40 msgr2=0x7f09dc10ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 --2- 172.21.15.46:0/1628188137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075f40 0x7f09dc10ebb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009880 tx=0x7f09c402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 -- 172.21.15.46:0/1628188137 shutdown_connections 2024-09-10T23:02:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 --2- 172.21.15.46:0/1628188137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075f40 0x7f09dc10ebb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 --2- 172.21.15.46:0/1628188137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075540 0x7f09dc075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 -- 172.21.15.46:0/1628188137 >> 172.21.15.46:0/1628188137 conn(0x7f09dc0fe5b0 msgr2=0x7f09dc1009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 -- 172.21.15.46:0/1628188137 shutdown_connections 2024-09-10T23:02:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.694+0000 7f09e1800640 1 -- 172.21.15.46:0/1628188137 wait complete. 2024-09-10T23:02:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.695+0000 7f09e1800640 1 Processor -- start 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.695+0000 7f09e1800640 1 -- start start 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09e1800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 0x7f09dc19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09e1800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075f40 0x7f09dc19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09e1800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc111d30 con 0x7f09dc075540 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09e1800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc111bb0 con 0x7f09dc075f40 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09daa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 0x7f09dc19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09daa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 0x7f09dc19a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36680/0 (socket says 172.21.15.46:36680) 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09daa00640 1 -- 172.21.15.46:0/2258225100 learned_addr learned my addr 172.21.15.46:0/2258225100 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09d2000640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075f40 0x7f09dc19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09daa00640 1 -- 172.21.15.46:0/2258225100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075f40 msgr2=0x7f09dc19ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09daa00640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075f40 0x7f09dc19ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09daa00640 1 -- 172.21.15.46:0/2258225100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc1a0210 con 0x7f09dc075540 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.696+0000 7f09d2000640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075f40 0x7f09dc19ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.697+0000 7f09daa00640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 0x7f09dc19a930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e970 tx=0x7f09cc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.697+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09cc00cac0 con 0x7f09dc075540 2024-09-10T23:02:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.697+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09cc0054b0 con 0x7f09dc075540 2024-09-10T23:02:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.697+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc1a0500 con 0x7f09dc075540 2024-09-10T23:02:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.697+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09cc004c40 con 0x7f09dc075540 2024-09-10T23:02:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.697+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc1a0ae0 con 0x7f09dc075540 2024-09-10T23:02:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.698+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc19b5f0 con 0x7f09dc075540 2024-09-10T23:02:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.700+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f09cc00cc60 con 0x7f09dc075540 2024-09-10T23:02:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.701+0000 7f09d3e00640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f09c007a370 0x7f09c007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.701+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f09cc09db70 con 0x7f09dc075540 2024-09-10T23:02:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.701+0000 7f09d2000640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f09c007a370 0x7f09c007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.702+0000 7f09d2000640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f09c007a370 0x7f09c007c830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09c4000c00 tx=0x7f09c4005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:35.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.705+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f09dc19b5f0 con 0x7f09dc075540 2024-09-10T23:02:35.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.946+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09dc10c1b0 con 0x7f09dc075540 2024-09-10T23:02:35.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.947+0000 7f09d3e00640 1 -- 172.21.15.46:0/2258225100 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+5759 (secure 0 0 0) 0x7f09cc064e70 con 0x7f09dc075540 2024-09-10T23:02:35.948 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":11,"btime":"2024-09-10T23:02:35:903340+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24445,"name":"foo.smithi073.nheemt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/91617916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":91617916},{"type":"v1","addr":"172.21.15.73:6833","nonce":91617916}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:12.132118+0000","modified":"2024-09-10T23:02:21.195967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"foo.smithi046.twlkrf","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1804766534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1804766534},{"type":"v1","addr":"172.21.15.46:6835","nonce":1804766534}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14622,"qdb_cluster":[14622]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:16.166322+0000","modified":"2024-09-10T23:02:34.921084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14662":{"gid":14662,"name":"bar.smithi046.pyflwx","rank":0,"incarnation":10,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.46:6837/3170779265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3170779265},{"type":"v1","addr":"172.21.15.46:6837","nonce":3170779265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-10T23:02:35.948 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 11 2024-09-10T23:02:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f09c007a370 msgr2=0x7f09c007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f09c007a370 0x7f09c007c830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09c4000c00 tx=0x7f09c4005a20 comp rx=0 tx=0).stop 2024-09-10T23:02:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 msgr2=0x7f09dc19a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:35.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 0x7f09dc19a930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e970 tx=0x7f09cc00ed70 comp rx=0 tx=0).stop 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 shutdown_connections 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f09c007a370 0x7f09c007c830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09dc075f40 0x7f09dc19ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 --2- 172.21.15.46:0/2258225100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09dc075540 0x7f09dc19a930 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 >> 172.21.15.46:0/2258225100 conn(0x7f09dc0fe5b0 msgr2=0x7f09dc109380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.949+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 shutdown_connections 2024-09-10T23:02:35.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:35.950+0000 7f09e1800640 1 -- 172.21.15.46:0/2258225100 wait complete. 2024-09-10T23:02:36.257 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: pgmap v265: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 15 B/s, 0 objects/s recovering 2024-09-10T23:02:36.258 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T23:02:36.258 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:reconnect 2024-09-10T23:02:36.258 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.73:6832/91617916,v1:172.21.15.73:6833/91617916] up:boot 2024-09-10T23:02:36.258 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1/1 {bar:0=bar.smithi046.pyflwx=up:reconnect,foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:36.258 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "foo.smithi073.nheemt"} : dispatch 2024-09-10T23:02:36.258 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:36 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2258225100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: pgmap v265: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 15 B/s, 0 objects/s recovering 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:reconnect 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.73:6832/91617916,v1:172.21.15.73:6833/91617916] up:boot 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1/1 {bar:0=bar.smithi046.pyflwx=up:reconnect,foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "foo.smithi073.nheemt"} : dispatch 2024-09-10T23:02:36.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:36 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2258225100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:36.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:02:16.166322+0000', 'modified': '2024-09-10T23:02:34.921084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 65, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14662}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14662': {'gid': 14662, 'name': 'bar.smithi046.pyflwx', 'rank': 0, 'incarnation': 10, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.46:6837/3170779265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 3170779265}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 3170779265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:02:36.630 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14662:up:reconnect 2024-09-10T23:02:37.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:02:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:38.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:rejoin 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1/1 {bar:0=bar.smithi046.pyflwx=up:rejoin,foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: daemon mds.bar.smithi046.pyflwx is now active in filesystem bar as rank 0 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: pgmap v266: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 15 B/s, 0 objects/s recovering 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:37 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:rejoin 2024-09-10T23:02:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1/1 {bar:0=bar.smithi046.pyflwx=up:rejoin,foo:0=foo.smithi046.twlkrf=up:active} 1 up:standby 2024-09-10T23:02:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: daemon mds.bar.smithi046.pyflwx is now active in filesystem bar as rank 0 2024-09-10T23:02:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: pgmap v266: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 15 B/s, 0 objects/s recovering 2024-09-10T23:02:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:38.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:37 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.061+0000 7f382a400640 1 -- 172.21.15.46:0/4117306277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382410a740 msgr2=0x7f382410ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.061+0000 7f382a400640 1 --2- 172.21.15.46:0/4117306277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382410a740 0x7f382410ab80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3810009880 tx=0x7f381002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.062+0000 7f382a400640 1 -- 172.21.15.46:0/4117306277 shutdown_connections 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.062+0000 7f382a400640 1 --2- 172.21.15.46:0/4117306277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f382410a740 0x7f382410ab80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.062+0000 7f382a400640 1 --2- 172.21.15.46:0/4117306277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3824104d30 0x7f3824105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.062+0000 7f382a400640 1 -- 172.21.15.46:0/4117306277 >> 172.21.15.46:0/4117306277 conn(0x7f3824100780 msgr2=0x7f3824102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.062+0000 7f382a400640 1 -- 172.21.15.46:0/4117306277 shutdown_connections 2024-09-10T23:02:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.062+0000 7f382a400640 1 -- 172.21.15.46:0/4117306277 wait complete. 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.063+0000 7f382a400640 1 Processor -- start 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.063+0000 7f382a400640 1 -- start start 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.063+0000 7f382a400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 0x7f382419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.063+0000 7f382a400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382410a740 0x7f382419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.063+0000 7f382a400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3824111d80 con 0x7f3824104d30 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.063+0000 7f382a400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3824111c00 con 0x7f382410a740 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 0x7f382419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 0x7f382419a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36698/0 (socket says 172.21.15.46:36698) 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 -- 172.21.15.46:0/4168166678 learned_addr learned my addr 172.21.15.46:0/4168166678 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3822a00640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382410a740 0x7f382419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:39.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 -- 172.21.15.46:0/4168166678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382410a740 msgr2=0x7f382419ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:39.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382410a740 0x7f382419ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 -- 172.21.15.46:0/4168166678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38241a0200 con 0x7f3824104d30 2024-09-10T23:02:39.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.064+0000 7f3823400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 0x7f382419a920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f381400e970 tx=0x7f381400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:39.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.065+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f381400cac0 con 0x7f3824104d30 2024-09-10T23:02:39.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.065+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38140054b0 con 0x7f3824104d30 2024-09-10T23:02:39.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.065+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3814004c40 con 0x7f3824104d30 2024-09-10T23:02:39.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.065+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38241a04f0 con 0x7f3824104d30 2024-09-10T23:02:39.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.065+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38241a0ad0 con 0x7f3824104d30 2024-09-10T23:02:39.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.066+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382419b5e0 con 0x7f3824104d30 2024-09-10T23:02:39.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.067+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f381400cc60 con 0x7f3824104d30 2024-09-10T23:02:39.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.069+0000 7f381be00640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f380807a370 0x7f380807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:39.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.069+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f381409db50 con 0x7f3824104d30 2024-09-10T23:02:39.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.069+0000 7f3822a00640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f380807a370 0x7f380807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:39.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.070+0000 7f3822a00640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f380807a370 0x7f380807c830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3810000c00 tx=0x7f3810005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:39.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.074+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f382419b5e0 con 0x7f3824104d30 2024-09-10T23:02:39.254 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:38 smithi073 ceph-mon[35473]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:02:39.254 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:38 smithi073 ceph-mon[35473]: Cluster is now healthy 2024-09-10T23:02:39.254 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:38 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:active 2024-09-10T23:02:39.254 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:38 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.73:6834/446864302,v1:172.21.15.73:6835/446864302] up:boot 2024-09-10T23:02:39.254 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:38 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1 {bar:0=bar.smithi046.pyflwx=up:active,foo:0=foo.smithi046.twlkrf=up:active} 2 up:standby 2024-09-10T23:02:39.254 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:38 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "bar.smithi073.rklcya"} : dispatch 2024-09-10T23:02:39.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:38 smithi046 ceph-mon[28128]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:02:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:38 smithi046 ceph-mon[28128]: Cluster is now healthy 2024-09-10T23:02:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:38 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:active 2024-09-10T23:02:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:38 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.73:6834/446864302,v1:172.21.15.73:6835/446864302] up:boot 2024-09-10T23:02:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:38 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1 {bar:0=bar.smithi046.pyflwx=up:active,foo:0=foo.smithi046.twlkrf=up:active} 2 up:standby 2024-09-10T23:02:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:38 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "mds metadata", "who": "bar.smithi073.rklcya"} : dispatch 2024-09-10T23:02:39.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.337+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3824105fe0 con 0x7f3824104d30 2024-09-10T23:02:39.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.338+0000 7f381be00640 1 -- 172.21.15.46:0/4168166678 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6607 (secure 0 0 0) 0x7f3814064e50 con 0x7f3824104d30 2024-09-10T23:02:39.339 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:02:39.339 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"btime":"2024-09-10T23:02:37:911097+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24445,"name":"foo.smithi073.nheemt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/91617916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":91617916},{"type":"v1","addr":"172.21.15.73:6833","nonce":91617916}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24453,"name":"bar.smithi073.rklcya","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/446864302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":446864302},{"type":"v1","addr":"172.21.15.73:6835","nonce":446864302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:12.132118+0000","modified":"2024-09-10T23:02:21.195967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"foo.smithi046.twlkrf","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1804766534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1804766534},{"type":"v1","addr":"172.21.15.46:6835","nonce":1804766534}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14622,"qdb_cluster":[14622]},"id":1},{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:02:16.166322+0000","modified":"2024-09-10T23:02:37.911092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14662":{"gid":14662,"name":"bar.smithi046.pyflwx","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3170779265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3170779265},{"type":"v1","addr":"172.21.15.46:6837","nonce":3170779265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14662,"qdb_cluster":[14662]},"id":2}]} 2024-09-10T23:02:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2024-09-10T23:02:39.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.340+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f380807a370 msgr2=0x7f380807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:39.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.340+0000 7f382a400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f380807a370 0x7f380807c830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3810000c00 tx=0x7f3810005a20 comp rx=0 tx=0).stop 2024-09-10T23:02:39.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.340+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 msgr2=0x7f382419a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:39.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.340+0000 7f382a400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 0x7f382419a920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f381400e970 tx=0x7f381400ed70 comp rx=0 tx=0).stop 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 shutdown_connections 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f380807a370 0x7f380807c830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382410a740 0x7f382419ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 --2- 172.21.15.46:0/4168166678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824104d30 0x7f382419a920 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 >> 172.21.15.46:0/4168166678 conn(0x7f3824100780 msgr2=0x7f3824102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 shutdown_connections 2024-09-10T23:02:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:39.341+0000 7f382a400640 1 -- 172.21.15.46:0/4168166678 wait complete. 2024-09-10T23:02:40.069 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:39 smithi046 ceph-mon[28128]: pgmap v267: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s; 12 B/s, 0 objects/s recovering 2024-09-10T23:02:40.070 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:39 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/4168166678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:39 smithi073 ceph-mon[35473]: pgmap v267: 129 pgs: 129 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s; 12 B/s, 0 objects/s recovering 2024-09-10T23:02:40.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:39 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/4168166678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:02:40.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:02:16.166322+0000', 'modified': '2024-09-10T23:02:37.911092+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 65, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14662}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14662': {'gid': 14662, 'name': 'bar.smithi046.pyflwx', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.46:6837/3170779265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 3170779265}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 3170779265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 14662, 'qdb_cluster': [14662]} 2024-09-10T23:02:40.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:02:40.493 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph tell mds.bar.smithi046.pyflwx status 2024-09-10T23:02:40.944 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:41.679 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:41.679 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:41.679 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:41.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 -- 172.21.15.46:0/1424818412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec104b80 msgr2=0x7f13ec104f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 --2- 172.21.15.46:0/1424818412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec104b80 0x7f13ec104f60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009880 tx=0x7f13dc02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 -- 172.21.15.46:0/1424818412 shutdown_connections 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 --2- 172.21.15.46:0/1424818412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec10a590 0x7f13ec10a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 --2- 172.21.15.46:0/1424818412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec104b80 0x7f13ec104f60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 -- 172.21.15.46:0/1424818412 >> 172.21.15.46:0/1424818412 conn(0x7f13ec1005f0 msgr2=0x7f13ec102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 -- 172.21.15.46:0/1424818412 shutdown_connections 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.710+0000 7f13ebe00640 1 -- 172.21.15.46:0/1424818412 wait complete. 2024-09-10T23:02:41.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.711+0000 7f13ebe00640 1 Processor -- start 2024-09-10T23:02:41.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.711+0000 7f13ebe00640 1 -- start start 2024-09-10T23:02:41.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.711+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec104b80 0x7f13ec0776b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.711+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 0x7f13ec077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.711+0000 7f13ebe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec111bd0 con 0x7f13ec10a590 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.711+0000 7f13ebe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec111a50 con 0x7f13ec104b80 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 0x7f13ec077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 0x7f13ec077bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36724/0 (socket says 172.21.15.46:36724) 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 -- 172.21.15.46:0/4202662133 learned_addr learned my addr 172.21.15.46:0/4202662133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13eaa00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec104b80 0x7f13ec0776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 -- 172.21.15.46:0/4202662133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec104b80 msgr2=0x7f13ec0776b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec104b80 0x7f13ec0776b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 -- 172.21.15.46:0/4202662133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ec07b680 con 0x7f13ec10a590 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13eaa00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec104b80 0x7f13ec0776b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:02:41.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.712+0000 7f13ea000640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 0x7f13ec077bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f13d800e970 tx=0x7f13d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:41.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.713+0000 7f13e3400640 1 -- 172.21.15.46:0/4202662133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13d800cac0 con 0x7f13ec10a590 2024-09-10T23:02:41.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.713+0000 7f13e3400640 1 -- 172.21.15.46:0/4202662133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13d80054b0 con 0x7f13ec10a590 2024-09-10T23:02:41.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.713+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ec078130 con 0x7f13ec10a590 2024-09-10T23:02:41.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.713+0000 7f13e3400640 1 -- 172.21.15.46:0/4202662133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13d8004c40 con 0x7f13ec10a590 2024-09-10T23:02:41.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.713+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ec1a8d30 con 0x7f13ec10a590 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13f4427740 1 Processor -- start 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13e3400640 1 -- 172.21.15.46:0/4202662133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f13d800cc60 con 0x7f13ec10a590 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13f4427740 1 -- start start 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13f4427740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f1780720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13f4427740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13f4427740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f6f16f7e00 con 0x55f6f1780340 2024-09-10T23:02:41.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.717+0000 7f13f4427740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f6f16e7230 con 0x55f6f1780c60 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f1780720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f1780720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36732/0 (socket says 172.21.15.46:36732) 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eb400640 1 -- 172.21.15.46:0/3499078421 learned_addr learned my addr 172.21.15.46:0/3499078421 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eaa00640 1 --2- 172.21.15.46:0/3499078421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13e3400640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f13d007a320 0x7f13d007c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eb400640 1 -- 172.21.15.46:0/3499078421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 msgr2=0x55f6f178c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:41.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eb400640 1 --2- 172.21.15.46:0/3499078421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13e3400640 1 -- 172.21.15.46:0/4202662133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f13d809dcc0 con 0x7f13ec10a590 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.718+0000 7f13eb400640 1 -- 172.21.15.46:0/3499078421 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f16b1b20 con 0x55f6f1780340 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.719+0000 7f13ea000640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f13d007a320 0x7f13d007c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.719+0000 7f13eb400640 1 --2- 172.21.15.46:0/3499078421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f1780720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009e00 tx=0x7f13e400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1638770b513da445 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.719+0000 7f13d7e00640 1 -- 172.21.15.46:0/3499078421 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e400bd80 con 0x55f6f1780340 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.719+0000 7f13d7e00640 1 -- 172.21.15.46:0/3499078421 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e4017070 con 0x55f6f1780340 2024-09-10T23:02:41.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.719+0000 7f13d7e00640 1 -- 172.21.15.46:0/3499078421 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e40116b0 con 0x55f6f1780340 2024-09-10T23:02:41.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 -- 172.21.15.46:0/3499078421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 msgr2=0x55f6f1780720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 --2- 172.21.15.46:0/3499078421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f1780720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009e00 tx=0x7f13e400b420 comp rx=0 tx=0).stop 2024-09-10T23:02:41.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13ea000640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f13d007a320 0x7f13d007c7e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13d80647d0 tx=0x7f13d80095b0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:41.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 -- 172.21.15.46:0/3499078421 shutdown_connections 2024-09-10T23:02:41.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 --2- 172.21.15.46:0/3499078421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 --2- 172.21.15.46:0/3499078421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f1780720 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 -- 172.21.15.46:0/3499078421 >> 172.21.15.46:0/3499078421 conn(0x55f6f177e120 msgr2=0x55f6f177f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 -- 172.21.15.46:0/3499078421 shutdown_connections 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.720+0000 7f13f4427740 1 -- 172.21.15.46:0/3499078421 wait complete. 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 1 -- start start 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 1 Processor -- start 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f178d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f6f1682510 con 0x55f6f1780340 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f6f16eb040 con 0x55f6f1780c60 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.721+0000 7f13f4427740 10 client.0 _ll_register_callbacks cb 0x55f6f16922c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:02:41.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f178d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f178d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36742/0 (socket says 172.21.15.46:36742) 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 -- 172.21.15.46:0/1375571814 learned_addr learned my addr 172.21.15.46:0/1375571814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eaa00640 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 -- 172.21.15.46:0/1375571814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 msgr2=0x55f6f178d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 -- 172.21.15.46:0/1375571814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f14456b0 con 0x55f6f1780340 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13eb400640 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f178d050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f13e4012cb0 tx=0x7f13e4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4cf65f1a52d849 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.722+0000 7f13d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13d4c00640 1 -- 172.21.15.46:0/1375571814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e4021070 con 0x55f6f1780340 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13d4c00640 1 -- 172.21.15.46:0/1375571814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f13e400f050 con 0x55f6f1780340 2024-09-10T23:02:41.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6f1684b20 con 0x55f6f1780340 2024-09-10T23:02:41.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13d4c00640 1 -- 172.21.15.46:0/1375571814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f13e402b050 con 0x55f6f1780340 2024-09-10T23:02:41.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13f4427740 10 client.14686 fetch_fsmap learned FSMap version 14 2024-09-10T23:02:41.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=3+}) -- 0x55f6f169f7a0 con 0x55f6f1780340 2024-09-10T23:02:41.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13d4c00640 1 -- 172.21.15.46:0/1375571814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f6f1684b20 con 0x55f6f1780340 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.723+0000 7f13d4c00640 1 -- 172.21.15.46:0/1375571814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 14) ==== 4216+0+0 (secure 0 0 0) 0x7f13e4011070 con 0x55f6f1780340 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13f4427740 10 client.14686 fetch_fsmap finished waiting for FSMap version 14 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13f4427740 10 client.14686 resolve_mds: resolved name 'bar.smithi046.pyflwx' to daemon mds.bar.smithi046.pyflwx 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13f4427740 20 client.14686 populate_metadata read hostname 'smithi046' 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13f4427740 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1799100 0x55f6f179c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13f4427740 4 client.14686 mds_command: new command op to 14662 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 --> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6f16f9d50 con 0x55f6f1799100 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.724+0000 7f13eaa00640 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1799100 0x55f6f179c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.725+0000 7f13eaa00640 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1799100 0x55f6f179c990 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6d3f6f9d0d25dd server_cookie=c47121bc2cfa4e55 in_seq=0 out_seq=0 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.725+0000 7f13d4c00640 10 client.14686 ms_handle_connect on v2:172.21.15.46:6836/3170779265 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.725+0000 7f13d4c00640 1 -- 172.21.15.46:0/1375571814 <== mds.0 v2:172.21.15.46:6836/3170779265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6f16f9d50 con 0x55f6f1799100 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.725+0000 7f13d4c00640 10 client.14686 handle_command_reply: tid=0 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.725+0000 7f13f4427740 1 client.14686 shutdown 2024-09-10T23:02:41.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 msgr2=0x55f6f178d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f178d050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f13e4012cb0 tx=0x7f13e4009510 comp rx=0 tx=0).stop 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 shutdown_connections 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1799100 0x55f6f179c990 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f178d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 --2- 172.21.15.46:0/1375571814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f178d050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 >> 172.21.15.46:0/1375571814 conn(0x55f6f177e120 msgr2=0x55f6f177d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13d4c00640 0 client.14686 ms_handle_reset on v2:172.21.15.46:6836/3170779265 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 shutdown_connections 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 1 -- 172.21.15.46:0/1375571814 wait complete. 2024-09-10T23:02:41.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.726+0000 7f13f4427740 20 client.14686 trim_cache size 0 max 16384 2024-09-10T23:02:41.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13f4427740 1 Processor -- start 2024-09-10T23:02:41.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13f4427740 1 -- start start 2024-09-10T23:02:41.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13f4427740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f17894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13f4427740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f1789a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13f4427740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1b1b80 con 0x55f6f1780340 2024-09-10T23:02:41.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13f4427740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1af4f0 con 0x55f6f1780c60 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13eb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f17894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13eb400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f17894e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36752/0 (socket says 172.21.15.46:36752) 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13eb400640 1 -- 172.21.15.46:0/2595589775 learned_addr learned my addr 172.21.15.46:0/2595589775 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.746+0000 7f13eaa00640 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f1789a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13eb400640 1 -- 172.21.15.46:0/2595589775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 msgr2=0x55f6f1789a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13eb400640 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f1789a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13eb400640 1 -- 172.21.15.46:0/2595589775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f1780a90 con 0x55f6f1780340 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13eaa00640 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f1789a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13eb400640 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f17894e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f13e40097b0 tx=0x7f13e40095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9dc6a94045401d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13d7400640 1 -- 172.21.15.46:0/2595589775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e4034020 con 0x55f6f1780340 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13d7400640 1 -- 172.21.15.46:0/2595589775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e4017040 con 0x55f6f1780340 2024-09-10T23:02:41.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.747+0000 7f13d7400640 1 -- 172.21.15.46:0/2595589775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e4021050 con 0x55f6f1780340 2024-09-10T23:02:41.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 -- 172.21.15.46:0/2595589775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 msgr2=0x55f6f17894e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f17894e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f13e40097b0 tx=0x7f13e40095d0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 -- 172.21.15.46:0/2595589775 shutdown_connections 2024-09-10T23:02:41.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780c60 0x55f6f1789a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 --2- 172.21.15.46:0/2595589775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780340 0x55f6f17894e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 -- 172.21.15.46:0/2595589775 >> 172.21.15.46:0/2595589775 conn(0x55f6f177e120 msgr2=0x55f6f178a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:41.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 -- 172.21.15.46:0/2595589775 shutdown_connections 2024-09-10T23:02:41.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 -- 172.21.15.46:0/2595589775 wait complete. 2024-09-10T23:02:41.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.748+0000 7f13f4427740 1 -- start start 2024-09-10T23:02:41.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13f4427740 1 Processor -- start 2024-09-10T23:02:41.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13f4427740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780340 0x55f6f179ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13f4427740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 0x55f6f179d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13f4427740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f6f1798f80 con 0x55f6f1780c60 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13f4427740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1afb40 con 0x55f6f1780340 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13f4427740 10 client.0 _ll_register_callbacks cb 0x7f13d8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 0x55f6f179d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 0x55f6f179d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36754/0 (socket says 172.21.15.46:36754) 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.749+0000 7f13eaa00640 1 -- 172.21.15.46:0/1471929246 learned_addr learned my addr 172.21.15.46:0/1471929246 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.750+0000 7f13eb400640 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780340 0x55f6f179ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.750+0000 7f13eaa00640 1 -- 172.21.15.46:0/1471929246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780340 msgr2=0x55f6f179ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.750+0000 7f13eaa00640 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780340 0x55f6f179ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.750+0000 7f13eaa00640 1 -- 172.21.15.46:0/1471929246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f17a06b0 con 0x55f6f1780c60 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.750+0000 7f13eaa00640 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 0x55f6f179d4e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009230 tx=0x7f13dc004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7835bc933f09c0b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:41.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.750+0000 7f13d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13d4c00640 1 -- 172.21.15.46:0/1471929246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13dc035040 con 0x55f6f1780c60 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13d4c00640 1 -- 172.21.15.46:0/1471929246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f13dc0046c0 con 0x55f6f1780c60 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e4017040 con 0x55f6f1780c60 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13d4c00640 1 -- 172.21.15.46:0/1471929246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f13dc054050 con 0x55f6f1780c60 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 10 client.14690 fetch_fsmap learned FSMap version 14 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=3+}) -- 0x55f6f1806650 con 0x55f6f1780c60 2024-09-10T23:02:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13d4c00640 1 -- 172.21.15.46:0/1471929246 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e4017040 con 0x55f6f1780c60 2024-09-10T23:02:41.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13d4c00640 1 -- 172.21.15.46:0/1471929246 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 14) ==== 4216+0+0 (secure 0 0 0) 0x7f13dc057020 con 0x55f6f1780c60 2024-09-10T23:02:41.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 10 client.14690 fetch_fsmap finished waiting for FSMap version 14 2024-09-10T23:02:41.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 10 client.14690 resolve_mds: resolved name 'bar.smithi046.pyflwx' to daemon mds.bar.smithi046.pyflwx 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 20 client.14690 populate_metadata read hostname 'smithi046' 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1807fa0 0x55f6f180a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 4 client.14690 mds_command: new command op to 14662 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.751+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 --> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] -- command(tid 0: {"prefix": "status"}) -- 0x55f6f1786eb0 con 0x55f6f1807fa0 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.752+0000 7f13eb400640 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1807fa0 0x55f6f180a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.752+0000 7f13eb400640 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1807fa0 0x55f6f180a390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698a989e6e2aedd2 server_cookie=dbf904e78381538b in_seq=0 out_seq=0 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.752+0000 7f13d4c00640 10 client.14690 ms_handle_connect on v2:172.21.15.46:6836/3170779265 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13d4c00640 1 -- 172.21.15.46:0/1471929246 <== mds.0 v2:172.21.15.46:6836/3170779265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55f6f1786eb0 con 0x55f6f1807fa0 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13d4c00640 10 client.14690 handle_command_reply: tid=0 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 client.14690 shutdown 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 msgr2=0x55f6f179d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 0x55f6f179d4e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009230 tx=0x7f13dc004160 comp rx=0 tx=0).stop 2024-09-10T23:02:41.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 shutdown_connections 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] conn(0x55f6f1807fa0 0x55f6f180a390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f6f1780c60 0x55f6f179d4e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 --2- 172.21.15.46:0/1471929246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6f1780340 0x55f6f179ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13d4c00640 0 client.14690 ms_handle_reset on v2:172.21.15.46:6836/3170779265 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 >> 172.21.15.46:0/1471929246 conn(0x55f6f177e120 msgr2=0x55f6f17894e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 shutdown_connections 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 1 -- 172.21.15.46:0/1471929246 wait complete. 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.753+0000 7f13f4427740 20 client.14690 trim_cache size 0 max 16384 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-10T23:02:41.756 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "52773b64-6fc7-11ef-bcea-c7b262605968", 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 14662, 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "bar", 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 6.8453419169999998, 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 14, 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 65, 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 65, 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 7.8344150179999996 2024-09-10T23:02:41.757 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f13d007a320 msgr2=0x7f13d007c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f13d007a320 0x7f13d007c7e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13d80647d0 tx=0x7f13d80095b0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 msgr2=0x7f13ec077bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 0x7f13ec077bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f13d800e970 tx=0x7f13d800ed70 comp rx=0 tx=0).stop 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 shutdown_connections 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f13d007a320 0x7f13d007c7e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10a590 0x7f13ec077bf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 --2- 172.21.15.46:0/4202662133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec104b80 0x7f13ec0776b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:41.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 >> 172.21.15.46:0/4202662133 conn(0x7f13ec1005f0 msgr2=0x7f13ec1029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:41.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 shutdown_connections 2024-09-10T23:02:41.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:41.754+0000 7f13ebe00640 1 -- 172.21.15.46:0/4202662133 wait complete. 2024-09-10T23:02:41.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:41.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:41.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:42.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:42 smithi046 ceph-mon[28128]: pgmap v268: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 9.8 KiB/s rd, 0 B/s wr, 9 op/s; 11 B/s, 0 objects/s recovering 2024-09-10T23:02:42.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:42 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:active 2024-09-10T23:02:42.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:42 smithi046 ceph-mon[28128]: mds.? [v2:172.21.15.73:6834/446864302,v1:172.21.15.73:6835/446864302] up:standby 2024-09-10T23:02:42.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:42 smithi046 ceph-mon[28128]: fsmap foo:1 bar:1 {bar:0=bar.smithi046.pyflwx=up:active,foo:0=foo.smithi046.twlkrf=up:active} 2 up:standby 2024-09-10T23:02:42.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:42 smithi073 ceph-mon[35473]: pgmap v268: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 9.8 KiB/s rd, 0 B/s wr, 9 op/s; 11 B/s, 0 objects/s recovering 2024-09-10T23:02:42.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:42 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.46:6836/3170779265,v1:172.21.15.46:6837/3170779265] up:active 2024-09-10T23:02:42.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:42 smithi073 ceph-mon[35473]: mds.? [v2:172.21.15.73:6834/446864302,v1:172.21.15.73:6835/446864302] up:standby 2024-09-10T23:02:42.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:42 smithi073 ceph-mon[35473]: fsmap foo:1 bar:1 {bar:0=bar.smithi046.pyflwx=up:active,foo:0=foo.smithi046.twlkrf=up:active} 2 up:standby 2024-09-10T23:02:42.857 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T23:02:42.884 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T23:02:42.884 INFO:tasks.ceph_fuse:config is {'client.0': {'cephfs_name': 'foo'}} 2024-09-10T23:02:42.884 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'foo'} 2024-09-10T23:02:42.884 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:02:42.884 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:42.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:42.884 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-10T23:02:42.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:42.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-10T23:02:43.022 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-09-10T23:02:43.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:02:43.025 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T23:02:43.025 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:02:43.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:02:43.764 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:44.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:44 smithi046 ceph-mon[28128]: pgmap v269: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-10T23:02:44.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:44 smithi073 ceph-mon[35473]: pgmap v269: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-10T23:02:45.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.017+0000 7fbbe9000640 1 -- 172.21.15.46:0/3735214416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe4075e00 msgr2=0x7fbbe410ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:45.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.017+0000 7fbbe9000640 1 --2- 172.21.15.46:0/3735214416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe4075e00 0x7fbbe410ea40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009880 tx=0x7fbbd002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.017+0000 7fbbe9000640 1 -- 172.21.15.46:0/3735214416 shutdown_connections 2024-09-10T23:02:45.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.017+0000 7fbbe9000640 1 --2- 172.21.15.46:0/3735214416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe4075e00 0x7fbbe410ea40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.017+0000 7fbbe9000640 1 --2- 172.21.15.46:0/3735214416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40754e0 0x7fbbe40758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.017+0000 7fbbe9000640 1 -- 172.21.15.46:0/3735214416 >> 172.21.15.46:0/3735214416 conn(0x7fbbe40fe3e0 msgr2=0x7fbbe4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.018+0000 7fbbe9000640 1 -- 172.21.15.46:0/3735214416 shutdown_connections 2024-09-10T23:02:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.018+0000 7fbbe9000640 1 -- 172.21.15.46:0/3735214416 wait complete. 2024-09-10T23:02:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe9000640 1 Processor -- start 2024-09-10T23:02:45.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe9000640 1 -- start start 2024-09-10T23:02:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 0x7fbbe419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe4075e00 0x7fbbe419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe9000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4111bc0 con 0x7fbbe40754e0 2024-09-10T23:02:45.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe9000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4111a40 con 0x7fbbe4075e00 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 0x7fbbe419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 0x7fbbe419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48044/0 (socket says 172.21.15.46:48044) 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.019+0000 7fbbe3400640 1 -- 172.21.15.46:0/2104481629 learned_addr learned my addr 172.21.15.46:0/2104481629 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbe2a00640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe4075e00 0x7fbbe419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbe3400640 1 -- 172.21.15.46:0/2104481629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe4075e00 msgr2=0x7fbbe419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbe3400640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe4075e00 0x7fbbe419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbe3400640 1 -- 172.21.15.46:0/2104481629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe41a0080 con 0x7fbbe40754e0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbe3400640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 0x7fbbe419a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d6f0 tx=0x7fbbd400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbd4017070 con 0x7fbbe40754e0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbd400de00 con 0x7fbbe40754e0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbd40049d0 con 0x7fbbe40754e0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.020+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe41a0370 con 0x7fbbe40754e0 2024-09-10T23:02:45.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.021+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe41a0980 con 0x7fbbe40754e0 2024-09-10T23:02:45.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.022+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe419b460 con 0x7fbbe40754e0 2024-09-10T23:02:45.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.023+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fbbd4004c80 con 0x7fbbe40754e0 2024-09-10T23:02:45.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.024+0000 7fbbdbe00640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbbc807a370 0x7fbbc807c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:45.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.024+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7fbbd409d210 con 0x7fbbe40754e0 2024-09-10T23:02:45.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.024+0000 7fbbe2a00640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbbc807a370 0x7fbbc807c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:45.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.025+0000 7fbbe2a00640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbbc807a370 0x7fbbc807c830 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4100ab0 tx=0x7fbbd0005a20 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.029+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbbe419b460 con 0x7fbbe40754e0 2024-09-10T23:02:45.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.274+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbbe410c040 con 0x7fbbe40754e0 2024-09-10T23:02:45.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.275+0000 7fbbdbe00640 1 -- 172.21.15.46:0/2104481629 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+148 (secure 0 0 0) 0x7fbbd4064510 con 0x7fbbe40754e0 2024-09-10T23:02:45.276 INFO:teuthology.orchestra.run.smithi046.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2024-09-10T23:02:45.276 INFO:teuthology.orchestra.run.smithi046.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbbc807a370 msgr2=0x7fbbc807c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbbc807a370 0x7fbbc807c830 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4100ab0 tx=0x7fbbd0005a20 comp rx=0 tx=0).stop 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 msgr2=0x7fbbe419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 0x7fbbe419a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d6f0 tx=0x7fbbd400dbb0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 shutdown_connections 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fbbc807a370 0x7fbbc807c830 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe4075e00 0x7fbbe419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 --2- 172.21.15.46:0/2104481629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbe40754e0 0x7fbbe419a7a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.278+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 >> 172.21.15.46:0/2104481629 conn(0x7fbbe40fe3e0 msgr2=0x7fbbe4109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.279+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 shutdown_connections 2024-09-10T23:02:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:45.279+0000 7fbbe9000640 1 -- 172.21.15.46:0/2104481629 wait complete. 2024-09-10T23:02:45.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:45 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2104481629' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:02:45.782 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:45 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2104481629' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:Mounting Ceph FS foo; just confirmed its presence on cluster 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:self.cephfs_name = foo 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:02:46.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:02:46.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:46.175 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-09-10T23:02:46.213 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:02:46.214 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42124sec preferred_lft 42124sec 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:46.215 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-09-10T23:02:46.216 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:02:46.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:46.216 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-10T23:02:46.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:02:46.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-09-10T23:02:46.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-09-10T23:02:46.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:02:46.217 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-10T23:02:46.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:46.612 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: pgmap v270: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 7 op/s; 6 B/s, 0 objects/s recovering 2024-09-10T23:02:46.612 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.612 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:46.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:46.648 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:02:46.707 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-09-10T23:02:46.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:46.710 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-09-10T23:02:46.755 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-09-10T23:02:46.755 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:02:46.756 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:02:46.756 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:02:46.756 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:02:46.756 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:46.756 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-10T23:02:46.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:02:46.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:02:46.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:02:46.757 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: pgmap v270: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 7 op/s; 6 B/s, 0 objects/s recovering 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:02:46.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:02:46.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:02:46.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:02:46.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:02:46.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:47.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:47.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:47.453 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-10T23:02:47.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:47.490 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-09-10T23:02:47.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:47.566 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-10T23:02:47.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:47.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T23:02:47.566 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-10T23:02:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:47.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:47.749 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T23:02:47.750 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-10T23:02:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:48.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:48.031 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:48.031 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-10T23:02:48.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-09-10T23:02:48.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:02:48.031 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-10T23:02:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:48.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:48.201 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'foo'} 2024-09-10T23:02:48.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:02:48.202 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:48.237 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:02:48.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:02:48.237 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:48.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-09-10T23:02:48.410 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-09-10T23:02:48.446 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:02:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5615a60e3be43a58df7937fda8c8354b267980629281abb72271ca10b422f994/merged 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9f8d441a2a8c668e57783208467192d999698e1bdfa231276171324a3fef265b/merged 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/bad6610ad8484fadc985eea6a7aa4a3e19e26a71c9b3a56f48ba4c97bd3f84fb/merged 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/00d8ceb7e1d6b20d111145187efe56d1972f3fb4414dc90350bef6eba5dccd32/merged 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/3c8869db846776e165e05cd606883c403fb5378be580b20a2a9cabbcccd1e2f4/merged 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/082275dc7f9dfecdd81de790ad8bc6c4adb10af6a6fa97dfdcb0c11fbe7120c9/merged 2024-09-10T23:02:48.448 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9ed58acc35802394ef299f5ef82e78a59c6785cdbe6f0841202bf079cff26fdc/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5980231983e55f949f015201811f5bf7c0b2b4998a2cbe5671612c3066595930/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/08eddbff9a07f168de89f81ffe4cdf76421d4e5191bdbb8ef82566a08446ff48/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b61dae2809268912a99d8dcccc178d1d7ea2391d5197a71df5ff367bb92c6a75/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/402bc66370543f66a59811e29b7e08139c46d6f9f18c98f67db31ace455094bf/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/c11f928a750afcdeb4da35962eedf5be3d284c1bd5b05674b69e38128e29a19c/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0cfa3d13e69860610d25738aff7c5555ea458c8db8dcc1528aef3df6abfaa5e7/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/2a956f8a604d897be7a99ea2e04610d63606ac423e96f65b8a55ad0b798d837e/merged 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:48.449 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:48.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:48.450 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-09-10T23:02:48.526 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:02:48.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=foo) 2024-09-10T23:02:48.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-09-10T23:02:48.633 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:02:48.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:48 smithi046 ceph-mon[28128]: pgmap v271: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T23:02:48.676 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-09-10T23:02:48.676 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-09-10T23:02:48.676 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-09-10T23:02:48.677 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5615a60e3be43a58df7937fda8c8354b267980629281abb72271ca10b422f994/merged 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9f8d441a2a8c668e57783208467192d999698e1bdfa231276171324a3fef265b/merged 2024-09-10T23:02:48.678 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/bad6610ad8484fadc985eea6a7aa4a3e19e26a71c9b3a56f48ba4c97bd3f84fb/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/00d8ceb7e1d6b20d111145187efe56d1972f3fb4414dc90350bef6eba5dccd32/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/3c8869db846776e165e05cd606883c403fb5378be580b20a2a9cabbcccd1e2f4/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/082275dc7f9dfecdd81de790ad8bc6c4adb10af6a6fa97dfdcb0c11fbe7120c9/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9ed58acc35802394ef299f5ef82e78a59c6785cdbe6f0841202bf079cff26fdc/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5980231983e55f949f015201811f5bf7c0b2b4998a2cbe5671612c3066595930/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/08eddbff9a07f168de89f81ffe4cdf76421d4e5191bdbb8ef82566a08446ff48/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b61dae2809268912a99d8dcccc178d1d7ea2391d5197a71df5ff367bb92c6a75/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/402bc66370543f66a59811e29b7e08139c46d6f9f18c98f67db31ace455094bf/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/c11f928a750afcdeb4da35962eedf5be3d284c1bd5b05674b69e38128e29a19c/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0cfa3d13e69860610d25738aff7c5555ea458c8db8dcc1528aef3df6abfaa5e7/merged 2024-09-10T23:02:48.679 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/2a956f8a604d897be7a99ea2e04610d63606ac423e96f65b8a55ad0b798d837e/merged 2024-09-10T23:02:48.680 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-09-10T23:02:48.680 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:48.680 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:48.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:48.681 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-09-10T23:02:48.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-09-10T23:02:48.762+0000 7f0212501480 -1 init, newargv = 0x55c39bff69b0 newargc=15 2024-09-10T23:02:48.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[82540]: starting ceph client 2024-09-10T23:02:48.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[82540]: starting fuse 2024-09-10T23:02:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:48 smithi073 ceph-mon[35473]: pgmap v271: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T23:02:49.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-09-10T23:02:49.928 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:02:49.966 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-09-10T23:02:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:02:49.968 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5615a60e3be43a58df7937fda8c8354b267980629281abb72271ca10b422f994/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9f8d441a2a8c668e57783208467192d999698e1bdfa231276171324a3fef265b/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/bad6610ad8484fadc985eea6a7aa4a3e19e26a71c9b3a56f48ba4c97bd3f84fb/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/00d8ceb7e1d6b20d111145187efe56d1972f3fb4414dc90350bef6eba5dccd32/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/3c8869db846776e165e05cd606883c403fb5378be580b20a2a9cabbcccd1e2f4/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/082275dc7f9dfecdd81de790ad8bc6c4adb10af6a6fa97dfdcb0c11fbe7120c9/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9ed58acc35802394ef299f5ef82e78a59c6785cdbe6f0841202bf079cff26fdc/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5980231983e55f949f015201811f5bf7c0b2b4998a2cbe5671612c3066595930/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/08eddbff9a07f168de89f81ffe4cdf76421d4e5191bdbb8ef82566a08446ff48/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b61dae2809268912a99d8dcccc178d1d7ea2391d5197a71df5ff367bb92c6a75/merged 2024-09-10T23:02:49.969 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/402bc66370543f66a59811e29b7e08139c46d6f9f18c98f67db31ace455094bf/merged 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/c11f928a750afcdeb4da35962eedf5be3d284c1bd5b05674b69e38128e29a19c/merged 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0cfa3d13e69860610d25738aff7c5555ea458c8db8dcc1528aef3df6abfaa5e7/merged 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/2a956f8a604d897be7a99ea2e04610d63606ac423e96f65b8a55ad0b798d837e/merged 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:02:49.970 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:49.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:49.971 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-09-10T23:02:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:144 2024-09-10T23:02:50.049 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [144] 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-10T23:02:50.049 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-09-10T23:02:50.050 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-09-10T23:02:50.051 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-09-10T23:02:50.051 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:02:50.051 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-10T23:02:50.051 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-09-10T23:02:50.051 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-09-10T23:02:50.215 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.82540.asok 2024-09-10T23:02:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:50.230 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.82540.asok 2024-09-10T23:02:50.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:50.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.82540.asok status 2024-09-10T23:02:50.417 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-10T23:02:50.417 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-09-10T23:02:50.417 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:02:50.417 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:02:50.417 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-09-10T23:02:50.417 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "82540", 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 14698, 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 14698 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-10T23:02:50.418 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3854994563 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3854994563 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.14698 192.168.0.1:0/3854994563", 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/3854994563", 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-09-10T23:02:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 8, 2024-09-10T23:02:50.420 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 65, 2024-09-10T23:02:50.420 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:02:50.420 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-09-10T23:02:50.420 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "foo" 2024-09-10T23:02:50.420 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-10T23:02:50.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:50.434 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-09-10T23:02:50.434 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:50.470 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-09-10T23:02:50.471 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:50.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:50.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:50.568 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T23:02:50.578 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T23:02:50.578 INFO:tasks.ceph_fuse:config is {'client.1': {'cephfs_name': 'bar'}} 2024-09-10T23:02:50.578 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'bar'} 2024-09-10T23:02:50.578 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:02:50.578 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:02:50.578 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T23:02:50.578 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:02:50.615 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T23:02:50.616 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:02:50.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:02:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:50 smithi046 ceph-mon[28128]: pgmap v272: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:02:50.922 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:50 smithi073 ceph-mon[35473]: pgmap v272: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:02:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:51.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 -- 172.21.15.46:0/3645581228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 msgr2=0x7faa0c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:51.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 --2- 172.21.15.46:0/3645581228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c10ec30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80098b0 tx=0x7fa9f802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 -- 172.21.15.46:0/3645581228 shutdown_connections 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 --2- 172.21.15.46:0/3645581228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c10ec30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 --2- 172.21.15.46:0/3645581228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 0x7faa0c0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 -- 172.21.15.46:0/3645581228 >> 172.21.15.46:0/3645581228 conn(0x7faa0c0fe5b0 msgr2=0x7faa0c1009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 -- 172.21.15.46:0/3645581228 shutdown_connections 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.663+0000 7faa13800640 1 -- 172.21.15.46:0/3645581228 wait complete. 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.664+0000 7faa13800640 1 Processor -- start 2024-09-10T23:02:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.664+0000 7faa13800640 1 -- start start 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.664+0000 7faa13800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 0x7faa0c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.664+0000 7faa13800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.664+0000 7faa13800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c111d80 con 0x7faa0c075de0 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.664+0000 7faa13800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c111c00 con 0x7faa0c0754c0 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48064/0 (socket says 172.21.15.46:48064) 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 -- 172.21.15.46:0/1750310130 learned_addr learned my addr 172.21.15.46:0/1750310130 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa10e00640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 0x7faa0c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 -- 172.21.15.46:0/1750310130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 msgr2=0x7faa0c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 0x7faa0c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 -- 172.21.15.46:0/1750310130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1a0280 con 0x7faa0c075de0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa10e00640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 0x7faa0c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.665+0000 7faa0be00640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c19aee0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005ab0 tx=0x7fa9f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.666+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9f803f070 con 0x7faa0c075de0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.666+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9f8004950 con 0x7faa0c075de0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.666+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1a0510 con 0x7faa0c075de0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.666+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9f8035030 con 0x7faa0c075de0 2024-09-10T23:02:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.666+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1a0a40 con 0x7faa0c075de0 2024-09-10T23:02:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.667+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c19b660 con 0x7faa0c075de0 2024-09-10T23:02:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.668+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fa9f80035f0 con 0x7faa0c075de0 2024-09-10T23:02:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.669+0000 7faa09600640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa9f407a320 0x7fa9f407c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.669+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7fa9f80be490 con 0x7faa0c075de0 2024-09-10T23:02:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.669+0000 7faa10e00640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa9f407a320 0x7fa9f407c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.670+0000 7faa10e00640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa9f407a320 0x7fa9f407c7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa00005d00 tx=0x7faa00005c70 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.674+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faa0c19b660 con 0x7faa0c075de0 2024-09-10T23:02:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.886+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faa0c10c230 con 0x7faa0c075de0 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.887+0000 7faa09600640 1 -- 172.21.15.46:0/1750310130 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v65) ==== 81+0+1006 (secure 0 0 0) 0x7fa9f80857a0 con 0x7faa0c075de0 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6833/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6832/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3052523989 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2163720030 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/220137103 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3240682838 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/263522480 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1989006756 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1231598076 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1514329312 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:51.889 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2623235150 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:listed 17 entries 2024-09-10T23:02:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa9f407a320 msgr2=0x7fa9f407c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa9f407a320 0x7fa9f407c7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa00005d00 tx=0x7faa00005c70 comp rx=0 tx=0).stop 2024-09-10T23:02:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 msgr2=0x7faa0c19aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c19aee0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005ab0 tx=0x7fa9f80045e0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 shutdown_connections 2024-09-10T23:02:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fa9f407a320 0x7fa9f407c7e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c075de0 0x7faa0c19aee0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 --2- 172.21.15.46:0/1750310130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa0c0754c0 0x7faa0c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.889+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 >> 172.21.15.46:0/1750310130 conn(0x7faa0c0fe5b0 msgr2=0x7faa0c109400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.890+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 shutdown_connections 2024-09-10T23:02:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:51.890+0000 7faa13800640 1 -- 172.21.15.46:0/1750310130 wait complete. 2024-09-10T23:02:52.755 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T23:02:52.755 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:02:52.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:02:52.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:52 smithi046 ceph-mon[28128]: pgmap v273: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:02:52.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:52 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1750310130' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:02:53.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:52 smithi073 ceph-mon[35473]: pgmap v273: 129 pgs: 129 active+clean; 581 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:02:53.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:52 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1750310130' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:02:53.219 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 -- 172.21.15.46:0/2449391438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 msgr2=0x7f16b4105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 --2- 172.21.15.46:0/2449391438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b4105110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009880 tx=0x7f16a402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 -- 172.21.15.46:0/2449391438 shutdown_connections 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 --2- 172.21.15.46:0/2449391438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b410a740 0x7f16b410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 --2- 172.21.15.46:0/2449391438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b4105110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 -- 172.21.15.46:0/2449391438 >> 172.21.15.46:0/2449391438 conn(0x7f16b4100780 msgr2=0x7f16b4102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 -- 172.21.15.46:0/2449391438 shutdown_connections 2024-09-10T23:02:53.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.760+0000 7f16bb200640 1 -- 172.21.15.46:0/2449391438 wait complete. 2024-09-10T23:02:53.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.761+0000 7f16bb200640 1 Processor -- start 2024-09-10T23:02:53.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.762+0000 7f16bb200640 1 -- start start 2024-09-10T23:02:53.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.762+0000 7f16bb200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:53.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.762+0000 7f16bb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b410a740 0x7f16b419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:53.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.762+0000 7f16bb200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f16b4111d60 con 0x7f16b4104d30 2024-09-10T23:02:53.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.762+0000 7f16bb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16b4111be0 con 0x7f16b410a740 2024-09-10T23:02:53.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.762+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55390/0 (socket says 172.21.15.46:55390) 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3e00640 1 -- 172.21.15.46:0/2963714718 learned_addr learned my addr 172.21.15.46:0/2963714718 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3400640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b410a740 0x7f16b419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3e00640 1 -- 172.21.15.46:0/2963714718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b410a740 msgr2=0x7f16b419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3e00640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b410a740 0x7f16b419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3e00640 1 -- 172.21.15.46:0/2963714718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b41a0280 con 0x7f16b4104d30 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.763+0000 7f16b3e00640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b419a9a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f16a4006010 tx=0x7f16a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:53.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.764+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a403f070 con 0x7f16b4104d30 2024-09-10T23:02:53.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.764+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b41a0510 con 0x7f16b4104d30 2024-09-10T23:02:53.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.764+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16a40049d0 con 0x7f16b4104d30 2024-09-10T23:02:53.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.764+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a4035030 con 0x7f16b4104d30 2024-09-10T23:02:53.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.764+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b41a0a40 con 0x7f16b4104d30 2024-09-10T23:02:53.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.765+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b419b660 con 0x7f16b4104d30 2024-09-10T23:02:53.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.766+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f16a4003b10 con 0x7f16b4104d30 2024-09-10T23:02:53.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.768+0000 7f16b0c00640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f169807a320 0x7f169807c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:53.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.768+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f16a40be500 con 0x7f16b4104d30 2024-09-10T23:02:53.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.768+0000 7f16b3400640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f169807a320 0x7f169807c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:53.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.769+0000 7f16b3400640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f169807a320 0x7f169807c7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16a0005e10 tx=0x7f16a0005da0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:53.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.775+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f16b419b660 con 0x7f16b4104d30 2024-09-10T23:02:53.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.991+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f16b4105fe0 con 0x7f16b4104d30 2024-09-10T23:02:53.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.992+0000 7f16b0c00640 1 -- 172.21.15.46:0/2963714718 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v65) ==== 81+0+1006 (secure 0 0 0) 0x7f16a4085780 con 0x7f16b4104d30 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6833/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6832/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3052523989 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2163720030 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/220137103 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3240682838 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/263522480 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1989006756 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:53.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:53.995 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:02:53.995 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1231598076 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:53.995 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:53.995 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1514329312 2024-09-11T22:54:15.921880+0000 2024-09-10T23:02:53.995 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2623235150 2024-09-11T22:55:30.890832+0000 2024-09-10T23:02:53.995 INFO:teuthology.orchestra.run.smithi046.stderr:listed 17 entries 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f169807a320 msgr2=0x7f169807c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f169807a320 0x7f169807c7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16a0005e10 tx=0x7f16a0005da0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 msgr2=0x7f16b419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b419a9a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f16a4006010 tx=0x7f16a40045e0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 shutdown_connections 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f169807a320 0x7f169807c7e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b410a740 0x7f16b419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 --2- 172.21.15.46:0/2963714718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16b4104d30 0x7f16b419a9a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:53.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.994+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 >> 172.21.15.46:0/2963714718 conn(0x7f16b4100780 msgr2=0x7f16b41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:53.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.995+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 shutdown_connections 2024-09-10T23:02:53.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:53.995+0000 7f16bb200640 1 -- 172.21.15.46:0/2963714718 wait complete. 2024-09-10T23:02:54.743 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:54 smithi046 ceph-mon[28128]: pgmap v274: 129 pgs: 129 active+clean; 582 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2024-09-10T23:02:54.743 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:54 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2963714718' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:02:54.782 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-09-10T23:02:54.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:54.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:02:54.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[82540]: fuse finished with error 0 and tester_r 0 2024-09-10T23:02:54.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:02:54.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-09-10T23:02:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:54.937 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:02:54.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:54.983 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-10T23:02:55.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:55.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-10T23:02:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:54 smithi073 ceph-mon[35473]: pgmap v274: 129 pgs: 129 active+clean; 582 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2024-09-10T23:02:55.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:54 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2963714718' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:02:55.129 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-09-10T23:02:55.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:02:55.132 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T23:02:55.132 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:02:55.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:02:55.518 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:02:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 -- 172.21.15.46:0/3955254879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 msgr2=0x7f56d4105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 --2- 172.21.15.46:0/3955254879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d4105110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009880 tx=0x7f56c802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 -- 172.21.15.46:0/3955254879 shutdown_connections 2024-09-10T23:02:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 --2- 172.21.15.46:0/3955254879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d410a740 0x7f56d410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 --2- 172.21.15.46:0/3955254879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d4105110 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 -- 172.21.15.46:0/3955254879 >> 172.21.15.46:0/3955254879 conn(0x7f56d4100780 msgr2=0x7f56d4102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 -- 172.21.15.46:0/3955254879 shutdown_connections 2024-09-10T23:02:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.058+0000 7f56dba00640 1 -- 172.21.15.46:0/3955254879 wait complete. 2024-09-10T23:02:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.059+0000 7f56dba00640 1 Processor -- start 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.059+0000 7f56dba00640 1 -- start start 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56dba00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56dba00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d410a740 0x7f56d419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56dba00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f56d4111d80 con 0x7f56d4104d30 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56dba00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56d4111c00 con 0x7f56d410a740 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d419a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55418/0 (socket says 172.21.15.46:55418) 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d9000640 1 -- 172.21.15.46:0/31706948 learned_addr learned my addr 172.21.15.46:0/31706948 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d3e00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d410a740 0x7f56d419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d9000640 1 -- 172.21.15.46:0/31706948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d410a740 msgr2=0x7f56d419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d9000640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d410a740 0x7f56d419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.060+0000 7f56d9000640 1 -- 172.21.15.46:0/31706948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d41a0240 con 0x7f56d4104d30 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.061+0000 7f56d9000640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d419a960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f56c802a9c0 tx=0x7f56c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.061+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56c803f070 con 0x7f56d4104d30 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.061+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56c8004a90 con 0x7f56d4104d30 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.061+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d41a04d0 con 0x7f56d4104d30 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.061+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56c8035030 con 0x7f56d4104d30 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.061+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d41a0a80 con 0x7f56d4104d30 2024-09-10T23:02:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.062+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d419b620 con 0x7f56d4104d30 2024-09-10T23:02:56.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.064+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f56c8003ba0 con 0x7f56d4104d30 2024-09-10T23:02:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.065+0000 7f56d1600640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f56bc07a320 0x7f56bc07c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:02:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.065+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f56c80be3d0 con 0x7f56d4104d30 2024-09-10T23:02:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.065+0000 7f56d3e00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f56bc07a320 0x7f56bc07c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:02:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.066+0000 7f56d3e00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f56bc07a320 0x7f56bc07c7e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005fd0 tx=0x7f56c0005850 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:02:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.069+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f56d419b620 con 0x7f56d4104d30 2024-09-10T23:02:56.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.306+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56d410cee0 con 0x7f56d4104d30 2024-09-10T23:02:56.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.306+0000 7f56d1600640 1 -- 172.21.15.46:0/31706948 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+148 (secure 0 0 0) 0x7f56c8085650 con 0x7f56d4104d30 2024-09-10T23:02:56.308 INFO:teuthology.orchestra.run.smithi046.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2024-09-10T23:02:56.308 INFO:teuthology.orchestra.run.smithi046.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2024-09-10T23:02:56.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f56bc07a320 msgr2=0x7f56bc07c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:56.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f56bc07a320 0x7f56bc07c7e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005fd0 tx=0x7f56c0005850 comp rx=0 tx=0).stop 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 msgr2=0x7f56d419a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d419a960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f56c802a9c0 tx=0x7f56c80045e0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 shutdown_connections 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f56bc07a320 0x7f56bc07c7e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d410a740 0x7f56d419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 --2- 172.21.15.46:0/31706948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56d4104d30 0x7f56d419a960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.309+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 >> 172.21.15.46:0/31706948 conn(0x7f56d4100780 msgr2=0x7f56d4102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.310+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 shutdown_connections 2024-09-10T23:02:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:02:56.310+0000 7f56dba00640 1 -- 172.21.15.46:0/31706948 wait complete. 2024-09-10T23:02:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:56 smithi046 ceph-mon[28128]: pgmap v275: 129 pgs: 129 active+clean; 582 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:02:57.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:56 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/31706948' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:02:57.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:56 smithi073 ceph-mon[35473]: pgmap v275: 129 pgs: 129 active+clean; 582 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:02:57.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:56 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/31706948' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:02:57.172 INFO:tasks.cephfs.mount:Mounting Ceph FS bar; just confirmed its presence on cluster 2024-09-10T23:02:57.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:02:57.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-10T23:02:57.172 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:02:57.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:02:57.172 INFO:tasks.cephfs.mount:self.cephfs_name = bar 2024-09-10T23:02:57.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:02:57.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:02:57.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:02:57.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:57.173 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-10T23:02:57.213 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:02:57.213 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:02:57.213 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:02:57.213 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:02:57.214 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:02:57.215 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42100sec preferred_lft 42100sec 2024-09-10T23:02:57.215 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link noprefixroute 2024-09-10T23:02:57.215 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:02:57.215 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:02:57.215 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T23:02:57.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:57.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:57.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:57.641 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:02:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-10T23:02:57.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:57.703 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-10T23:02:57.749 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-10T23:02:57.749 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:02:57.749 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:02:57.749 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:02:57.749 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:02:57.750 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:57.750 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T23:02:57.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:02:57.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:02:57.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:02:57.750 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T23:02:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:58.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:58.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:58.361 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-10T23:02:58.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:58.398 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-09-10T23:02:58.474 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:58.474 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T23:02:58.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:02:58.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T23:02:58.474 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T23:02:58.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:58.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:58.656 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T23:02:58.657 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T23:02:58.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:58.860 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:02:58 smithi073 ceph-mon[35473]: pgmap v276: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:02:58.869 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:02:58 smithi046 ceph-mon[28128]: pgmap v276: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:02:58.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:58.905 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:02:58.905 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T23:02:58.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-10T23:02:58.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:02:58.905 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T23:02:58.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:02:59.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:02:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:02:59.072 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'bar'} 2024-09-10T23:02:59.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:02:59.072 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:02:59.108 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:02:59.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:02:59.109 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:02:59.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-10T23:02:59.281 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:02:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-10T23:02:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-10T23:02:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-10T23:02:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-10T23:02:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-10T23:02:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:02:59.319 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/4d8d58c942845f7272b64f4cff43b0ec3850ca47f1fbe6e393818e62c95a9214/merged 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/7d4dc1fd1ad7a55cc87afb427ba1765fcfd5b256699f393b83f93552da0dbf16/merged 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/d29640608a3b9c299bb765900157db80b3a621be9b2699106d97dd8efc2a2e09/merged 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/52d65d9ee77ed4a78b200360154b6a302f6e4fae5ddae3b234f388f248178eee/merged 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/6a22e693cb6cb0457cd6731bd2fc9270a815745c291ae412f798fa49d6f9b04b/merged 2024-09-10T23:02:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ac007d63be38eafcfb7ef5044449f5f3fa9e003ef5d91c296e0656d421e71caa/merged 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/1bceeb4b7d6bb242b9b7368e6e333392013d82c1874b10257000b2c9f075a7cf/merged 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/986a0230ef8f6c0a218eed97aee240a07cb0a15b4cc6d19adc9112eea5771ad6/merged 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a3e9ab5c01e2fdb1c451ed7ff08c5a5c644498e9f62ccbb1a4f7ca1d097da885/merged 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/46f6f3e65a637f704d480d2f7f369b523de3e04e0dd07c1decdd49ce60d49072/merged 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/9d4806d8493e2f6a62ce33dcf5a2fb4a2099738437f61ee589b4f2011e27ca68/merged 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:02:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:02:59.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:59.322 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-10T23:02:59.397 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:02:59.397 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=bar) 2024-09-10T23:02:59.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-10T23:02:59.498 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-10T23:02:59.535 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/4d8d58c942845f7272b64f4cff43b0ec3850ca47f1fbe6e393818e62c95a9214/merged 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/7d4dc1fd1ad7a55cc87afb427ba1765fcfd5b256699f393b83f93552da0dbf16/merged 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/d29640608a3b9c299bb765900157db80b3a621be9b2699106d97dd8efc2a2e09/merged 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/52d65d9ee77ed4a78b200360154b6a302f6e4fae5ddae3b234f388f248178eee/merged 2024-09-10T23:02:59.536 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/6a22e693cb6cb0457cd6731bd2fc9270a815745c291ae412f798fa49d6f9b04b/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ac007d63be38eafcfb7ef5044449f5f3fa9e003ef5d91c296e0656d421e71caa/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/1bceeb4b7d6bb242b9b7368e6e333392013d82c1874b10257000b2c9f075a7cf/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/986a0230ef8f6c0a218eed97aee240a07cb0a15b4cc6d19adc9112eea5771ad6/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a3e9ab5c01e2fdb1c451ed7ff08c5a5c644498e9f62ccbb1a4f7ca1d097da885/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/46f6f3e65a637f704d480d2f7f369b523de3e04e0dd07c1decdd49ce60d49072/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/9d4806d8493e2f6a62ce33dcf5a2fb4a2099738437f61ee589b4f2011e27ca68/merged 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:02:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:02:59.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:02:59.538 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-10T23:02:59.659 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:2024-09-10T23:02:59.658+0000 7f3a7ef82480 -1 init, newargv = 0x558757f73790 newargc=15 2024-09-10T23:02:59.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[64759]: starting ceph client 2024-09-10T23:02:59.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[64759]: starting fuse 2024-09-10T23:03:00.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-10T23:03:00.781 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-10T23:03:00.820 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:03:00.821 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/4d8d58c942845f7272b64f4cff43b0ec3850ca47f1fbe6e393818e62c95a9214/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/7d4dc1fd1ad7a55cc87afb427ba1765fcfd5b256699f393b83f93552da0dbf16/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/d29640608a3b9c299bb765900157db80b3a621be9b2699106d97dd8efc2a2e09/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/52d65d9ee77ed4a78b200360154b6a302f6e4fae5ddae3b234f388f248178eee/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/6a22e693cb6cb0457cd6731bd2fc9270a815745c291ae412f798fa49d6f9b04b/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ac007d63be38eafcfb7ef5044449f5f3fa9e003ef5d91c296e0656d421e71caa/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/1bceeb4b7d6bb242b9b7368e6e333392013d82c1874b10257000b2c9f075a7cf/merged 2024-09-10T23:03:00.822 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/986a0230ef8f6c0a218eed97aee240a07cb0a15b4cc6d19adc9112eea5771ad6/merged 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a3e9ab5c01e2fdb1c451ed7ff08c5a5c644498e9f62ccbb1a4f7ca1d097da885/merged 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/46f6f3e65a637f704d480d2f7f369b523de3e04e0dd07c1decdd49ce60d49072/merged 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/9d4806d8493e2f6a62ce33dcf5a2fb4a2099738437f61ee589b4f2011e27ca68/merged 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:03:00.823 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:00.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:03:00.824 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-10T23:03:00.900 INFO:teuthology.orchestra.run.smithi073.stdout:132 2024-09-10T23:03:00.900 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [132] 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T23:03:00.901 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:03:00.902 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-10T23:03:00.903 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.1")) 2024-09-10T23:03:00.903 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-10T23:03:00.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:00 smithi073 ceph-mon[35473]: pgmap v277: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:03:01.046 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.1.64759.asok 2024-09-10T23:03:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T23:03:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:03:01.060 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.64759.asok 2024-09-10T23:03:01.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:03:01.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.64759.asok status 2024-09-10T23:03:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:00 smithi046 ceph-mon[28128]: pgmap v277: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:03:01.244 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T23:03:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-10T23:03:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:03:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:03:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "1", 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "64759", 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24489, 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 24489 2024-09-10T23:03:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4116038701 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4116038701 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.24489 192.168.0.1:0/4116038701", 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/4116038701", 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-10T23:03:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 14, 2024-09-10T23:03:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 65, 2024-09-10T23:03:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:03:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-10T23:03:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "bar" 2024-09-10T23:03:01.247 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T23:03:01.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:03:01.257 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-10T23:03:01.257 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:01.293 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-10T23:03:01.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:01.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:03:01.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:01.391 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T23:03:01.406 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:03:01.406 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T23:03:01.406 INFO:tasks.workunit:timeout=3h 2024-09-10T23:03:01.406 INFO:tasks.workunit:cleanup=True 2024-09-10T23:03:01.406 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:03:01.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:03:01.447 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T23:03:01.447 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:03:01.525 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T23:03:01.525 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T23:03:01.602 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:01.640 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:01.640 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 84h/132d Inode: 1 Links: 2 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 23:02:21.191041915 +0000 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 23:03:01.387019414 +0000 2024-09-10T23:03:01.641 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-10T23:03:01.641 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-10T23:03:01.641 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-10T23:03:01.748 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:03:01.749 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:03:01.786 INFO:tasks.workunit.client.1.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-10T23:03:01.787 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T23:03:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:02 smithi046 ceph-mon[28128]: pgmap v278: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-10T23:03:03.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:02 smithi073 ceph-mon[35473]: pgmap v278: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-10T23:03:04.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:04 smithi073 ceph-mon[35473]: pgmap v279: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-10T23:03:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:04 smithi046 ceph-mon[28128]: pgmap v279: 129 pgs: 129 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-10T23:03:07.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:06 smithi046 ceph-mon[28128]: pgmap v280: 129 pgs: 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:03:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:06 smithi073 ceph-mon[35473]: pgmap v280: 129 pgs: 129 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:03:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:08 smithi046 ceph-mon[28128]: pgmap v281: 129 pgs: 129 active+clean; 586 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:08 smithi073 ceph-mon[35473]: pgmap v281: 129 pgs: 129 active+clean; 586 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:10.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:10 smithi073 ceph-mon[35473]: pgmap v282: 129 pgs: 129 active+clean; 586 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-10T23:03:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:10 smithi046 ceph-mon[28128]: pgmap v282: 129 pgs: 129 active+clean; 586 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-09-10T23:03:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:12 smithi046 ceph-mon[28128]: pgmap v283: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-10T23:03:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:12 smithi073 ceph-mon[35473]: pgmap v283: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-10T23:03:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:14 smithi046 ceph-mon[28128]: pgmap v284: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:14 smithi073 ceph-mon[35473]: pgmap v284: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:16 smithi046 ceph-mon[28128]: pgmap v285: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:16 smithi073 ceph-mon[35473]: pgmap v285: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:18 smithi046 ceph-mon[28128]: pgmap v286: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:18 smithi073 ceph-mon[35473]: pgmap v286: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-09-10T23:03:20.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:20 smithi073 ceph-mon[35473]: pgmap v287: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:03:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:20 smithi046 ceph-mon[28128]: pgmap v287: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:03:23.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:22 smithi046 ceph-mon[28128]: pgmap v288: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:03:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:22 smithi073 ceph-mon[35473]: pgmap v288: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:03:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:24 smithi046 ceph-mon[28128]: pgmap v289: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:24 smithi073 ceph-mon[35473]: pgmap v289: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:27.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:26 smithi046 ceph-mon[28128]: pgmap v290: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:26 smithi073 ceph-mon[35473]: pgmap v290: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:28 smithi046 ceph-mon[28128]: pgmap v291: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:29.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:28 smithi073 ceph-mon[35473]: pgmap v291: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:30.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:30 smithi073 ceph-mon[35473]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:30 smithi046 ceph-mon[28128]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:32 smithi046 ceph-mon[28128]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:32 smithi073 ceph-mon[35473]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:34.956 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:34 smithi046 ceph-mon[28128]: pgmap v294: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:35.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:34 smithi073 ceph-mon[35473]: pgmap v294: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:36 smithi046 ceph-mon[28128]: pgmap v295: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:37.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:36 smithi073 ceph-mon[35473]: pgmap v295: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:38 smithi046 ceph-mon[28128]: pgmap v296: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:39.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:38 smithi073 ceph-mon[35473]: pgmap v296: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:40 smithi046 ceph-mon[28128]: pgmap v297: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:40 smithi073 ceph-mon[35473]: pgmap v297: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:42 smithi046 ceph-mon[28128]: pgmap v298: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:43.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:42 smithi073 ceph-mon[35473]: pgmap v298: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:44 smithi046 ceph-mon[28128]: pgmap v299: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:45.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:44 smithi073 ceph-mon[35473]: pgmap v299: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:46 smithi046 ceph-mon[28128]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:47.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:46 smithi073 ceph-mon[35473]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:03:48.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:03:48.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:03:49.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:48 smithi046 ceph-mon[28128]: pgmap v301: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:49.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:48 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:03:49.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:48 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:03:49.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:48 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:03:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:48 smithi073 ceph-mon[35473]: pgmap v301: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:48 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:03:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:48 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:03:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:48 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:03:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:50 smithi046 ceph-mon[28128]: pgmap v302: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:51.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:50 smithi073 ceph-mon[35473]: pgmap v302: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:52 smithi046 ceph-mon[28128]: pgmap v303: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:52 smithi073 ceph-mon[35473]: pgmap v303: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:54 smithi046 ceph-mon[28128]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:55.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:54 smithi073 ceph-mon[35473]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:57.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:56 smithi046 ceph-mon[28128]: pgmap v305: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:57.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:56 smithi073 ceph-mon[35473]: pgmap v305: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:03:58 smithi046 ceph-mon[28128]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:03:58 smithi073 ceph-mon[35473]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:03:59.369 INFO:tasks.workunit.client.1.smithi073.stderr:Updating files: 67% (8139/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T23:04:00.523 INFO:tasks.workunit.client.1.smithi073.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T23:04:00.523 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.523 INFO:tasks.workunit.client.1.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T23:04:00.523 INFO:tasks.workunit.client.1.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T23:04:00.523 INFO:tasks.workunit.client.1.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: git switch -c 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr:Or undo this operation with: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: git switch - 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T23:04:00.524 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-09-10T23:04:00.525 INFO:tasks.workunit.client.1.smithi073.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:04:00.535 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-10T23:04:00.617 INFO:tasks.workunit.client.1.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T23:04:00.621 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T23:04:00.621 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T23:04:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:00 smithi046 ceph-mon[28128]: pgmap v307: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:04:01.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:00 smithi073 ceph-mon[35473]: pgmap v307: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:04:01.307 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T23:04:01.417 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T23:04:01.482 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T23:04:01.486 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T23:04:01.486 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T23:04:01.550 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T23:04:01.557 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T23:04:01.557 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-10T23:04:01.633 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2024-09-10T23:04:01.634 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-09-10T23:04:01.634 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2024-09-10T23:04:01.731 INFO:tasks.workunit.client.1.smithi073.stderr:+ dbench 1 2024-09-10T23:04:01.754 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 63% (7698/12088) Updating files: 64% (7737/12088) Updating files: 65% (7858/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T23:04:01.756 INFO:tasks.workunit.client.1.smithi073.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-10T23:04:01.757 INFO:tasks.workunit.client.1.smithi073.stdout: 2024-09-10T23:04:01.757 INFO:tasks.workunit.client.1.smithi073.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-10T23:04:01.761 INFO:tasks.workunit.client.1.smithi073.stdout:0 of 1 processes prepared for launch 0 sec 2024-09-10T23:04:01.861 INFO:tasks.workunit.client.1.smithi073.stdout:1 of 1 processes prepared for launch 0 sec 2024-09-10T23:04:01.862 INFO:tasks.workunit.client.1.smithi073.stdout:releasing clients 2024-09-10T23:04:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:02.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 731 21.31 MB/sec warmup 1 sec latency 16.118 ms 2024-09-10T23:04:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:02 smithi046 ceph-mon[28128]: pgmap v308: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:04:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:02 smithi073 ceph-mon[35473]: pgmap v308: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:04:03.302 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-09-10T23:04:03.303 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.304 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-09-10T23:04:03.304 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.304 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T23:04:03.304 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-10T23:04:03.304 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:04:03.324 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T23:04:03.407 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T23:04:03.412 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:04:03.412 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T23:04:03.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 1200 11.52 MB/sec warmup 2 sec latency 16.224 ms 2024-09-10T23:04:04.133 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T23:04:04.233 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T23:04:04.307 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:04:04.310 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:04:04.311 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T23:04:04.385 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:04:04.393 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T23:04:04.393 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T23:04:04.430 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-09-10T23:04:04.433 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-09-10T23:04:04.434 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-09-10T23:04:04.522 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 1 2024-09-10T23:04:04.538 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-10T23:04:04.538 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-10T23:04:04.539 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-10T23:04:04.542 INFO:tasks.workunit.client.0.smithi046.stdout:0 of 1 processes prepared for launch 0 sec 2024-09-10T23:04:04.643 INFO:tasks.workunit.client.0.smithi046.stdout:1 of 1 processes prepared for launch 0 sec 2024-09-10T23:04:04.643 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-09-10T23:04:04.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 1707 8.74 MB/sec warmup 3 sec latency 19.226 ms 2024-09-10T23:04:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:04 smithi046 ceph-mon[28128]: pgmap v309: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:04:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:04 smithi073 ceph-mon[35473]: pgmap v309: 129 pgs: 129 active+clean; 587 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:04:05.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2922 33.48 MB/sec warmup 1 sec latency 50.220 ms 2024-09-10T23:04:05.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 2200 6.69 MB/sec warmup 4 sec latency 20.043 ms 2024-09-10T23:04:06.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5453 22.75 MB/sec warmup 2 sec latency 46.594 ms 2024-09-10T23:04:06.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 2619 5.81 MB/sec warmup 5 sec latency 20.191 ms 2024-09-10T23:04:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:06 smithi046 ceph-mon[28128]: pgmap v310: 129 pgs: 129 active+clean; 10 MiB data, 266 MiB used, 715 GiB / 715 GiB avail; 814 KiB/s wr, 4 op/s 2024-09-10T23:04:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:06 smithi073 ceph-mon[35473]: pgmap v310: 129 pgs: 129 active+clean; 10 MiB data, 266 MiB used, 715 GiB / 715 GiB avail; 814 KiB/s wr, 4 op/s 2024-09-10T23:04:07.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7902 19.90 MB/sec warmup 3 sec latency 163.997 ms 2024-09-10T23:04:07.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 3307 5.89 MB/sec warmup 6 sec latency 31.779 ms 2024-09-10T23:04:08.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11332 19.63 MB/sec warmup 4 sec latency 131.223 ms 2024-09-10T23:04:08.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 3707 5.54 MB/sec warmup 7 sec latency 16.025 ms 2024-09-10T23:04:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:08 smithi046 ceph-mon[28128]: pgmap v311: 129 pgs: 129 active+clean; 22 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s wr, 22 op/s 2024-09-10T23:04:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:08 smithi073 ceph-mon[35473]: pgmap v311: 129 pgs: 129 active+clean; 22 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s wr, 22 op/s 2024-09-10T23:04:09.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13988 18.55 MB/sec warmup 5 sec latency 43.296 ms 2024-09-10T23:04:09.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 4010 5.01 MB/sec warmup 8 sec latency 17.757 ms 2024-09-10T23:04:10.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17174 18.33 MB/sec warmup 6 sec latency 55.346 ms 2024-09-10T23:04:10.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 4424 4.52 MB/sec warmup 9 sec latency 20.431 ms 2024-09-10T23:04:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:10 smithi046 ceph-mon[28128]: pgmap v312: 129 pgs: 129 active+clean; 22 MiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s wr, 24 op/s 2024-09-10T23:04:11.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:10 smithi073 ceph-mon[35473]: pgmap v312: 129 pgs: 129 active+clean; 22 MiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s wr, 24 op/s 2024-09-10T23:04:11.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 19639 17.42 MB/sec warmup 7 sec latency 50.162 ms 2024-09-10T23:04:11.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 4943 4.51 MB/sec warmup 10 sec latency 18.013 ms 2024-09-10T23:04:12.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 22127 17.03 MB/sec warmup 8 sec latency 165.240 ms 2024-09-10T23:04:12.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 5371 4.13 MB/sec warmup 11 sec latency 98.199 ms 2024-09-10T23:04:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:12 smithi046 ceph-mon[28128]: pgmap v313: 129 pgs: 129 active+clean; 25 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 2.4 MiB/s wr, 44 op/s 2024-09-10T23:04:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:12 smithi073 ceph-mon[35473]: pgmap v313: 129 pgs: 129 active+clean; 25 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 2.4 MiB/s wr, 44 op/s 2024-09-10T23:04:13.643 INFO:tasks.workunit.client.0.smithi046.stdout: 1 25609 17.24 MB/sec warmup 9 sec latency 55.738 ms 2024-09-10T23:04:13.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 5884 3.91 MB/sec warmup 12 sec latency 19.979 ms 2024-09-10T23:04:14.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 27853 16.74 MB/sec warmup 10 sec latency 270.633 ms 2024-09-10T23:04:14.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 6437 3.95 MB/sec warmup 13 sec latency 35.846 ms 2024-09-10T23:04:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:14 smithi046 ceph-mon[28128]: pgmap v314: 129 pgs: 129 active+clean; 25 MiB data, 307 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 2.4 MiB/s wr, 45 op/s 2024-09-10T23:04:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:14 smithi073 ceph-mon[35473]: pgmap v314: 129 pgs: 129 active+clean; 25 MiB data, 307 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 2.4 MiB/s wr, 45 op/s 2024-09-10T23:04:15.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 30896 16.52 MB/sec warmup 11 sec latency 48.563 ms 2024-09-10T23:04:15.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 6882 3.89 MB/sec warmup 14 sec latency 22.479 ms 2024-09-10T23:04:16.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 33604 16.53 MB/sec warmup 12 sec latency 74.832 ms 2024-09-10T23:04:16.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 7368 3.93 MB/sec warmup 15 sec latency 15.770 ms 2024-09-10T23:04:16.990 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:16 smithi073 ceph-mon[35473]: pgmap v315: 129 pgs: 129 active+clean; 24 MiB data, 305 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.5 MiB/s wr, 53 op/s 2024-09-10T23:04:16.990 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:16 smithi046 ceph-mon[28128]: pgmap v315: 129 pgs: 129 active+clean; 24 MiB data, 305 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.5 MiB/s wr, 53 op/s 2024-09-10T23:04:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:17.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 36394 16.38 MB/sec warmup 13 sec latency 50.033 ms 2024-09-10T23:04:17.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 7645 3.70 MB/sec warmup 16 sec latency 17.571 ms 2024-09-10T23:04:18.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 39856 16.56 MB/sec warmup 14 sec latency 53.998 ms 2024-09-10T23:04:18.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 8105 3.54 MB/sec warmup 17 sec latency 18.319 ms 2024-09-10T23:04:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:18 smithi046 ceph-mon[28128]: pgmap v316: 129 pgs: 129 active+clean; 24 MiB data, 310 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 MiB/s wr, 71 op/s 2024-09-10T23:04:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:18 smithi073 ceph-mon[35473]: pgmap v316: 129 pgs: 129 active+clean; 24 MiB data, 310 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 MiB/s wr, 71 op/s 2024-09-10T23:04:19.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 43330 16.72 MB/sec warmup 15 sec latency 48.762 ms 2024-09-10T23:04:19.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 8575 3.57 MB/sec warmup 18 sec latency 30.847 ms 2024-09-10T23:04:20.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 46826 16.86 MB/sec warmup 16 sec latency 50.088 ms 2024-09-10T23:04:20.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 9068 3.40 MB/sec warmup 19 sec latency 17.444 ms 2024-09-10T23:04:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:20 smithi046 ceph-mon[28128]: pgmap v317: 129 pgs: 129 active+clean; 25 MiB data, 317 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1024 KiB/s wr, 56 op/s 2024-09-10T23:04:21.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:20 smithi073 ceph-mon[35473]: pgmap v317: 129 pgs: 129 active+clean; 25 MiB data, 317 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1024 KiB/s wr, 56 op/s 2024-09-10T23:04:21.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 49447 16.70 MB/sec warmup 17 sec latency 47.656 ms 2024-09-10T23:04:21.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 9532 3.32 MB/sec warmup 20 sec latency 18.080 ms 2024-09-10T23:04:22.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 52108 16.43 MB/sec warmup 18 sec latency 150.083 ms 2024-09-10T23:04:22.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 10123 3.42 MB/sec warmup 21 sec latency 17.943 ms 2024-09-10T23:04:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:22 smithi046 ceph-mon[28128]: pgmap v318: 129 pgs: 129 active+clean; 27 MiB data, 324 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-10T23:04:23.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:22 smithi073 ceph-mon[35473]: pgmap v318: 129 pgs: 129 active+clean; 27 MiB data, 324 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-10T23:04:23.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 55128 16.49 MB/sec warmup 19 sec latency 46.442 ms 2024-09-10T23:04:23.862 INFO:tasks.workunit.client.1.smithi073.stdout: 1 10602 3.48 MB/sec warmup 22 sec latency 15.945 ms 2024-09-10T23:04:24.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 57773 16.39 MB/sec warmup 20 sec latency 83.641 ms 2024-09-10T23:04:24.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 10988 3.40 MB/sec warmup 23 sec latency 17.840 ms 2024-09-10T23:04:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:24 smithi046 ceph-mon[28128]: pgmap v319: 129 pgs: 129 active+clean; 27 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:04:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:24 smithi073 ceph-mon[35473]: pgmap v319: 129 pgs: 129 active+clean; 27 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:04:25.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 61141 16.50 MB/sec warmup 21 sec latency 101.245 ms 2024-09-10T23:04:25.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 11305 3.27 MB/sec warmup 24 sec latency 22.001 ms 2024-09-10T23:04:26.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 64611 16.61 MB/sec warmup 22 sec latency 54.603 ms 2024-09-10T23:04:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:26 smithi046 ceph-mon[28128]: pgmap v320: 129 pgs: 129 active+clean; 26 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:04:26.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 11763 3.21 MB/sec warmup 25 sec latency 22.530 ms 2024-09-10T23:04:27.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:26 smithi073 ceph-mon[35473]: pgmap v320: 129 pgs: 129 active+clean; 26 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:04:27.644 INFO:tasks.workunit.client.0.smithi046.stdout: 1 68102 16.72 MB/sec warmup 23 sec latency 49.306 ms 2024-09-10T23:04:27.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 12265 3.21 MB/sec warmup 26 sec latency 16.435 ms 2024-09-10T23:04:28.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 68350 16.05 MB/sec warmup 24 sec latency 500.146 ms 2024-09-10T23:04:28.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 12748 3.11 MB/sec warmup 27 sec latency 20.920 ms 2024-09-10T23:04:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:28 smithi046 ceph-mon[28128]: pgmap v321: 129 pgs: 129 active+clean; 27 MiB data, 328 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-09-10T23:04:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:28 smithi073 ceph-mon[35473]: pgmap v321: 129 pgs: 129 active+clean; 27 MiB data, 328 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-09-10T23:04:29.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 71644 16.14 MB/sec warmup 25 sec latency 379.620 ms 2024-09-10T23:04:29.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 13203 3.08 MB/sec warmup 28 sec latency 35.547 ms 2024-09-10T23:04:30.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 74322 16.07 MB/sec warmup 26 sec latency 41.341 ms 2024-09-10T23:04:30.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 13646 3.13 MB/sec warmup 29 sec latency 185.465 ms 2024-09-10T23:04:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:30 smithi046 ceph-mon[28128]: pgmap v322: 129 pgs: 129 active+clean; 27 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:04:31.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:30 smithi073 ceph-mon[35473]: pgmap v322: 129 pgs: 129 active+clean; 27 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:04:31.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 76987 15.92 MB/sec warmup 27 sec latency 100.301 ms 2024-09-10T23:04:31.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 14042 3.09 MB/sec warmup 30 sec latency 16.899 ms 2024-09-10T23:04:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:32.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 79979 15.97 MB/sec warmup 28 sec latency 45.301 ms 2024-09-10T23:04:32.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 14536 3.14 MB/sec warmup 31 sec latency 13.882 ms 2024-09-10T23:04:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:32 smithi046 ceph-mon[28128]: pgmap v323: 129 pgs: 129 active+clean; 27 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:04:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:32 smithi073 ceph-mon[35473]: pgmap v323: 129 pgs: 129 active+clean; 27 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:04:33.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 82377 15.90 MB/sec warmup 29 sec latency 362.612 ms 2024-09-10T23:04:33.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 14718 3.05 MB/sec warmup 32 sec latency 340.438 ms 2024-09-10T23:04:34.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 82380 15.37 MB/sec warmup 30 sec latency 700.180 ms 2024-09-10T23:04:34.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 15145 2.98 MB/sec warmup 33 sec latency 24.723 ms 2024-09-10T23:04:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:34 smithi046 ceph-mon[28128]: pgmap v324: 129 pgs: 129 active+clean; 27 MiB data, 327 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 967 KiB/s wr, 54 op/s 2024-09-10T23:04:35.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:34 smithi073 ceph-mon[35473]: pgmap v324: 129 pgs: 129 active+clean; 27 MiB data, 327 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 967 KiB/s wr, 54 op/s 2024-09-10T23:04:35.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 82436 14.88 MB/sec warmup 31 sec latency 1612.640 ms 2024-09-10T23:04:35.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 15621 3.01 MB/sec warmup 34 sec latency 104.867 ms 2024-09-10T23:04:36.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 82436 14.42 MB/sec warmup 32 sec latency 1048.555 ms 2024-09-10T23:04:36.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 15978 2.94 MB/sec warmup 35 sec latency 283.575 ms 2024-09-10T23:04:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:36 smithi046 ceph-mon[28128]: pgmap v325: 129 pgs: 129 active+clean; 30 MiB data, 331 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-10T23:04:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:36 smithi073 ceph-mon[35473]: pgmap v325: 129 pgs: 129 active+clean; 30 MiB data, 331 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-10T23:04:37.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 82438 13.98 MB/sec warmup 33 sec latency 1380.985 ms 2024-09-10T23:04:37.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 16496 2.90 MB/sec warmup 36 sec latency 16.559 ms 2024-09-10T23:04:38.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 82519 13.57 MB/sec warmup 34 sec latency 1190.090 ms 2024-09-10T23:04:38.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 16810 2.85 MB/sec warmup 37 sec latency 163.806 ms 2024-09-10T23:04:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:38 smithi046 ceph-mon[28128]: pgmap v326: 129 pgs: 129 active+clean; 30 MiB data, 341 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-10T23:04:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:38 smithi073 ceph-mon[35473]: pgmap v326: 129 pgs: 129 active+clean; 30 MiB data, 341 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-10T23:04:39.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 85977 13.73 MB/sec warmup 35 sec latency 50.025 ms 2024-09-10T23:04:39.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 17499 2.94 MB/sec warmup 38 sec latency 20.628 ms 2024-09-10T23:04:40.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 89411 13.87 MB/sec warmup 36 sec latency 83.108 ms 2024-09-10T23:04:40.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 17904 2.96 MB/sec warmup 39 sec latency 18.473 ms 2024-09-10T23:04:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:40 smithi046 ceph-mon[28128]: pgmap v327: 129 pgs: 129 active+clean; 30 MiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 982 KiB/s wr, 56 op/s 2024-09-10T23:04:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:40 smithi073 ceph-mon[35473]: pgmap v327: 129 pgs: 129 active+clean; 30 MiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 982 KiB/s wr, 56 op/s 2024-09-10T23:04:41.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 92051 13.88 MB/sec warmup 37 sec latency 42.502 ms 2024-09-10T23:04:41.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 18210 2.91 MB/sec warmup 40 sec latency 15.034 ms 2024-09-10T23:04:42.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 94163 13.78 MB/sec warmup 38 sec latency 154.057 ms 2024-09-10T23:04:42.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 18634 2.86 MB/sec warmup 41 sec latency 27.365 ms 2024-09-10T23:04:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:42 smithi046 ceph-mon[28128]: pgmap v328: 129 pgs: 129 active+clean; 30 MiB data, 344 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:04:43.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:42 smithi073 ceph-mon[35473]: pgmap v328: 129 pgs: 129 active+clean; 30 MiB data, 344 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:04:43.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 96500 13.78 MB/sec warmup 39 sec latency 385.215 ms 2024-09-10T23:04:43.863 INFO:tasks.workunit.client.1.smithi073.stdout: 1 19140 2.90 MB/sec warmup 42 sec latency 18.246 ms 2024-09-10T23:04:44.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 99153 13.79 MB/sec warmup 40 sec latency 56.912 ms 2024-09-10T23:04:44.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 19617 2.84 MB/sec warmup 43 sec latency 15.922 ms 2024-09-10T23:04:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:44 smithi046 ceph-mon[28128]: pgmap v329: 129 pgs: 129 active+clean; 29 MiB data, 344 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-09-10T23:04:45.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:44 smithi073 ceph-mon[35473]: pgmap v329: 129 pgs: 129 active+clean; 29 MiB data, 344 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-09-10T23:04:45.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 102263 13.86 MB/sec warmup 41 sec latency 58.694 ms 2024-09-10T23:04:45.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 20149 2.81 MB/sec warmup 44 sec latency 17.684 ms 2024-09-10T23:04:46.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 104804 13.83 MB/sec warmup 42 sec latency 54.736 ms 2024-09-10T23:04:46.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 20746 2.87 MB/sec warmup 45 sec latency 18.495 ms 2024-09-10T23:04:47.059 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:46 smithi046 ceph-mon[28128]: pgmap v330: 129 pgs: 129 active+clean; 32 MiB data, 350 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:04:47.059 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:46 smithi073 ceph-mon[35473]: pgmap v330: 129 pgs: 129 active+clean; 32 MiB data, 350 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:04:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:04:47.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 107377 13.85 MB/sec warmup 43 sec latency 83.554 ms 2024-09-10T23:04:47.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 21120 2.85 MB/sec warmup 46 sec latency 17.547 ms 2024-09-10T23:04:48.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 109747 13.84 MB/sec warmup 44 sec latency 400.319 ms 2024-09-10T23:04:48.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 21622 2.88 MB/sec warmup 47 sec latency 18.044 ms 2024-09-10T23:04:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:48 smithi046 ceph-mon[28128]: pgmap v331: 129 pgs: 129 active+clean; 30 MiB data, 354 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.1 MiB/s wr, 60 op/s 2024-09-10T23:04:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:48 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:04:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:48 smithi073 ceph-mon[35473]: pgmap v331: 129 pgs: 129 active+clean; 30 MiB data, 354 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.1 MiB/s wr, 60 op/s 2024-09-10T23:04:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:48 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:04:49.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 111488 13.75 MB/sec warmup 45 sec latency 648.357 ms 2024-09-10T23:04:49.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 21918 2.83 MB/sec warmup 48 sec latency 18.705 ms 2024-09-10T23:04:50.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:04:50.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:04:50.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:04:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:04:50.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:49 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:04:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:04:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:04:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:04:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:04:50.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:49 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:04:50.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 114427 13.77 MB/sec warmup 46 sec latency 46.906 ms 2024-09-10T23:04:50.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 22381 2.81 MB/sec warmup 49 sec latency 25.638 ms 2024-09-10T23:04:51.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:50 smithi073 ceph-mon[35473]: pgmap v332: 129 pgs: 129 active+clean; 29 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 890 KiB/s wr, 58 op/s 2024-09-10T23:04:51.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:50 smithi046 ceph-mon[28128]: pgmap v332: 129 pgs: 129 active+clean; 29 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 890 KiB/s wr, 58 op/s 2024-09-10T23:04:51.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 117892 13.88 MB/sec warmup 47 sec latency 43.765 ms 2024-09-10T23:04:51.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 22888 2.82 MB/sec warmup 50 sec latency 17.730 ms 2024-09-10T23:04:52.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 121368 13.99 MB/sec warmup 48 sec latency 58.500 ms 2024-09-10T23:04:52.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 23381 2.77 MB/sec warmup 51 sec latency 19.942 ms 2024-09-10T23:04:53.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:52 smithi073 ceph-mon[35473]: pgmap v333: 129 pgs: 129 active+clean; 33 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:04:53.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:52 smithi046 ceph-mon[28128]: pgmap v333: 129 pgs: 129 active+clean; 33 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:04:53.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 124859 14.09 MB/sec warmup 49 sec latency 66.731 ms 2024-09-10T23:04:53.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 23820 2.76 MB/sec warmup 52 sec latency 38.815 ms 2024-09-10T23:04:54.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 124917 13.81 MB/sec warmup 50 sec latency 458.517 ms 2024-09-10T23:04:54.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 24589 2.83 MB/sec warmup 53 sec latency 23.766 ms 2024-09-10T23:04:55.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:54 smithi046 ceph-mon[28128]: pgmap v334: 129 pgs: 129 active+clean; 33 MiB data, 359 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:04:55.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:54 smithi073 ceph-mon[35473]: pgmap v334: 129 pgs: 129 active+clean; 33 MiB data, 359 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:04:55.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 128408 13.91 MB/sec warmup 51 sec latency 52.680 ms 2024-09-10T23:04:55.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 24885 2.84 MB/sec warmup 54 sec latency 19.303 ms 2024-09-10T23:04:56.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 130923 13.90 MB/sec warmup 52 sec latency 75.073 ms 2024-09-10T23:04:56.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 25254 2.82 MB/sec warmup 55 sec latency 17.589 ms 2024-09-10T23:04:57.313 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:56 smithi046 ceph-mon[28128]: pgmap v335: 129 pgs: 129 active+clean; 34 MiB data, 359 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:04:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:56 smithi073 ceph-mon[35473]: pgmap v335: 129 pgs: 129 active+clean; 34 MiB data, 359 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:04:57.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 133756 13.89 MB/sec warmup 53 sec latency 49.239 ms 2024-09-10T23:04:57.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 25591 2.77 MB/sec warmup 56 sec latency 18.863 ms 2024-09-10T23:04:58.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 136458 13.94 MB/sec warmup 54 sec latency 99.325 ms 2024-09-10T23:04:58.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 26050 2.75 MB/sec warmup 57 sec latency 29.403 ms 2024-09-10T23:04:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:04:58 smithi046 ceph-mon[28128]: pgmap v336: 129 pgs: 129 active+clean; 33 MiB data, 359 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:04:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:04:58 smithi073 ceph-mon[35473]: pgmap v336: 129 pgs: 129 active+clean; 33 MiB data, 359 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:04:59.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 139168 13.95 MB/sec warmup 55 sec latency 245.241 ms 2024-09-10T23:04:59.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 26408 2.76 MB/sec warmup 58 sec latency 300.817 ms 2024-09-10T23:05:00.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 140745 13.82 MB/sec warmup 56 sec latency 749.332 ms 2024-09-10T23:05:00.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 26863 2.72 MB/sec warmup 59 sec latency 403.627 ms 2024-09-10T23:05:01.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:00 smithi046 ceph-mon[28128]: pgmap v337: 129 pgs: 129 active+clean; 33 MiB data, 361 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:05:01.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:00 smithi073 ceph-mon[35473]: pgmap v337: 129 pgs: 129 active+clean; 33 MiB data, 361 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:05:01.646 INFO:tasks.workunit.client.0.smithi046.stdout: 1 143020 13.82 MB/sec warmup 57 sec latency 105.735 ms 2024-09-10T23:05:01.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 27308 2.70 MB/sec warmup 60 sec latency 21.078 ms 2024-09-10T23:05:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:02.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:02.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 146346 13.89 MB/sec warmup 58 sec latency 82.825 ms 2024-09-10T23:05:02.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 28038 2.75 MB/sec warmup 61 sec latency 18.906 ms 2024-09-10T23:05:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:02 smithi046 ceph-mon[28128]: pgmap v338: 129 pgs: 129 active+clean; 34 MiB data, 370 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-10T23:05:03.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:02 smithi073 ceph-mon[35473]: pgmap v338: 129 pgs: 129 active+clean; 34 MiB data, 370 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-10T23:05:03.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 149803 13.98 MB/sec warmup 59 sec latency 56.531 ms 2024-09-10T23:05:03.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 28264 2.73 MB/sec warmup 62 sec latency 21.206 ms 2024-09-10T23:05:04.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 153290 14.06 MB/sec warmup 60 sec latency 41.584 ms 2024-09-10T23:05:04.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 28755 2.76 MB/sec warmup 63 sec latency 15.224 ms 2024-09-10T23:05:05.131 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:04 smithi073 ceph-mon[35473]: pgmap v339: 129 pgs: 129 active+clean; 32 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 989 KiB/s wr, 55 op/s 2024-09-10T23:05:05.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:04 smithi046 ceph-mon[28128]: pgmap v339: 129 pgs: 129 active+clean; 32 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 989 KiB/s wr, 55 op/s 2024-09-10T23:05:05.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 153543 13.84 MB/sec warmup 61 sec latency 485.569 ms 2024-09-10T23:05:05.864 INFO:tasks.workunit.client.1.smithi073.stdout: 1 29074 2.72 MB/sec warmup 64 sec latency 17.978 ms 2024-09-10T23:05:06.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 156893 13.92 MB/sec warmup 62 sec latency 600.750 ms 2024-09-10T23:05:06.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 29513 2.71 MB/sec warmup 65 sec latency 29.112 ms 2024-09-10T23:05:07.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:06 smithi046 ceph-mon[28128]: pgmap v340: 129 pgs: 129 active+clean; 34 MiB data, 374 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:05:07.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:06 smithi073 ceph-mon[35473]: pgmap v340: 129 pgs: 129 active+clean; 34 MiB data, 374 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:05:07.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 160372 14.00 MB/sec warmup 63 sec latency 54.452 ms 2024-09-10T23:05:07.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 30026 2.71 MB/sec warmup 66 sec latency 19.345 ms 2024-09-10T23:05:08.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 163860 14.08 MB/sec warmup 64 sec latency 57.478 ms 2024-09-10T23:05:08.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 30510 2.68 MB/sec warmup 67 sec latency 16.223 ms 2024-09-10T23:05:09.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:08 smithi046 ceph-mon[28128]: pgmap v341: 129 pgs: 129 active+clean; 36 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:05:09.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:08 smithi073 ceph-mon[35473]: pgmap v341: 129 pgs: 129 active+clean; 36 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:05:09.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 165600 13.97 MB/sec warmup 65 sec latency 175.111 ms 2024-09-10T23:05:09.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 30979 2.68 MB/sec warmup 68 sec latency 17.560 ms 2024-09-10T23:05:10.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:09 smithi046 ceph-mon[28128]: pgmap v342: 129 pgs: 129 active+clean; 35 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 970 KiB/s wr, 58 op/s 2024-09-10T23:05:10.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:09 smithi073 ceph-mon[35473]: pgmap v342: 129 pgs: 129 active+clean; 35 MiB data, 383 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 970 KiB/s wr, 58 op/s 2024-09-10T23:05:10.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 168372 14.01 MB/sec warmup 66 sec latency 55.029 ms 2024-09-10T23:05:10.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 31705 2.73 MB/sec warmup 69 sec latency 15.769 ms 2024-09-10T23:05:11.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 169150 13.83 MB/sec warmup 67 sec latency 656.364 ms 2024-09-10T23:05:11.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 32079 2.74 MB/sec warmup 70 sec latency 16.490 ms 2024-09-10T23:05:12.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:12 smithi046 ceph-mon[28128]: pgmap v343: 129 pgs: 129 active+clean; 34 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-10T23:05:12.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:12 smithi073 ceph-mon[35473]: pgmap v343: 129 pgs: 129 active+clean; 34 MiB data, 384 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-10T23:05:12.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 171911 13.88 MB/sec warmup 68 sec latency 66.303 ms 2024-09-10T23:05:12.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 32405 2.72 MB/sec warmup 71 sec latency 14.408 ms 2024-09-10T23:05:13.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 174706 13.89 MB/sec warmup 69 sec latency 58.365 ms 2024-09-10T23:05:13.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 32789 2.69 MB/sec warmup 72 sec latency 18.525 ms 2024-09-10T23:05:14.647 INFO:tasks.workunit.client.0.smithi046.stdout: 1 178110 13.96 MB/sec warmup 70 sec latency 58.410 ms 2024-09-10T23:05:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:14 smithi046 ceph-mon[28128]: pgmap v344: 129 pgs: 129 active+clean; 35 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1023 KiB/s wr, 57 op/s 2024-09-10T23:05:14.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:14 smithi073 ceph-mon[35473]: pgmap v344: 129 pgs: 129 active+clean; 35 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1023 KiB/s wr, 57 op/s 2024-09-10T23:05:14.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 33251 2.68 MB/sec warmup 73 sec latency 16.528 ms 2024-09-10T23:05:15.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 181598 14.03 MB/sec warmup 71 sec latency 49.890 ms 2024-09-10T23:05:15.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 33790 2.68 MB/sec warmup 74 sec latency 16.522 ms 2024-09-10T23:05:16.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 183911 14.01 MB/sec warmup 72 sec latency 127.191 ms 2024-09-10T23:05:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:16 smithi046 ceph-mon[28128]: pgmap v345: 129 pgs: 129 active+clean; 36 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:05:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:16 smithi073 ceph-mon[35473]: pgmap v345: 129 pgs: 129 active+clean; 36 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:05:16.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:16.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 34299 2.67 MB/sec warmup 75 sec latency 16.063 ms 2024-09-10T23:05:17.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 186802 14.00 MB/sec warmup 73 sec latency 47.589 ms 2024-09-10T23:05:17.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 34864 2.70 MB/sec warmup 76 sec latency 16.381 ms 2024-09-10T23:05:18.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 189644 14.05 MB/sec warmup 74 sec latency 50.133 ms 2024-09-10T23:05:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:18 smithi046 ceph-mon[28128]: pgmap v346: 129 pgs: 129 active+clean; 37 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:05:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:18 smithi073 ceph-mon[35473]: pgmap v346: 129 pgs: 129 active+clean; 37 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:05:18.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 35299 2.69 MB/sec warmup 77 sec latency 16.217 ms 2024-09-10T23:05:19.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 192434 14.06 MB/sec warmup 75 sec latency 50.264 ms 2024-09-10T23:05:19.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 35783 2.72 MB/sec warmup 78 sec latency 17.920 ms 2024-09-10T23:05:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:20 smithi046 ceph-mon[28128]: pgmap v347: 129 pgs: 129 active+clean; 37 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 976 KiB/s wr, 57 op/s 2024-09-10T23:05:20.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 195904 14.12 MB/sec warmup 76 sec latency 46.327 ms 2024-09-10T23:05:20.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:20 smithi073 ceph-mon[35473]: pgmap v347: 129 pgs: 129 active+clean; 37 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 976 KiB/s wr, 57 op/s 2024-09-10T23:05:20.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 36062 2.69 MB/sec warmup 79 sec latency 22.810 ms 2024-09-10T23:05:21.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 199383 14.18 MB/sec warmup 77 sec latency 51.741 ms 2024-09-10T23:05:21.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 36495 2.66 MB/sec warmup 80 sec latency 22.758 ms 2024-09-10T23:05:22.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 202869 14.25 MB/sec warmup 78 sec latency 116.498 ms 2024-09-10T23:05:22.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:22 smithi046 ceph-mon[28128]: pgmap v348: 129 pgs: 129 active+clean; 37 MiB data, 403 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:05:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:22 smithi073 ceph-mon[35473]: pgmap v348: 129 pgs: 129 active+clean; 37 MiB data, 403 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:05:22.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 36989 2.68 MB/sec warmup 81 sec latency 20.026 ms 2024-09-10T23:05:23.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 205523 14.24 MB/sec warmup 79 sec latency 40.464 ms 2024-09-10T23:05:23.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 37487 2.65 MB/sec warmup 82 sec latency 21.511 ms 2024-09-10T23:05:24.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 208725 14.28 MB/sec warmup 80 sec latency 49.083 ms 2024-09-10T23:05:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:24 smithi046 ceph-mon[28128]: pgmap v349: 129 pgs: 129 active+clean; 39 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:05:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:24 smithi073 ceph-mon[35473]: pgmap v349: 129 pgs: 129 active+clean; 39 MiB data, 405 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:05:24.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 37949 2.64 MB/sec warmup 83 sec latency 15.466 ms 2024-09-10T23:05:25.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 211757 14.28 MB/sec warmup 81 sec latency 43.123 ms 2024-09-10T23:05:25.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 38470 2.68 MB/sec warmup 84 sec latency 232.265 ms 2024-09-10T23:05:26.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 214719 14.31 MB/sec warmup 82 sec latency 55.350 ms 2024-09-10T23:05:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:26 smithi046 ceph-mon[28128]: pgmap v350: 129 pgs: 129 active+clean; 38 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:05:26.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:26 smithi073 ceph-mon[35473]: pgmap v350: 129 pgs: 129 active+clean; 38 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:05:26.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 38857 2.67 MB/sec warmup 85 sec latency 17.526 ms 2024-09-10T23:05:27.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 218060 14.37 MB/sec warmup 83 sec latency 49.201 ms 2024-09-10T23:05:27.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 39356 2.69 MB/sec warmup 86 sec latency 14.626 ms 2024-09-10T23:05:28.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 220958 14.38 MB/sec warmup 84 sec latency 49.107 ms 2024-09-10T23:05:28.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:28 smithi046 ceph-mon[28128]: pgmap v351: 129 pgs: 129 active+clean; 38 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:05:28.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:28 smithi073 ceph-mon[35473]: pgmap v351: 129 pgs: 129 active+clean; 38 MiB data, 388 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:05:28.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 39661 2.66 MB/sec warmup 87 sec latency 17.571 ms 2024-09-10T23:05:29.648 INFO:tasks.workunit.client.0.smithi046.stdout: 1 224323 14.43 MB/sec warmup 85 sec latency 56.955 ms 2024-09-10T23:05:29.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 40110 2.65 MB/sec warmup 88 sec latency 35.181 ms 2024-09-10T23:05:30.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:30 smithi046 ceph-mon[28128]: pgmap v352: 129 pgs: 129 active+clean; 39 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:05:30.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 227797 14.48 MB/sec warmup 86 sec latency 43.525 ms 2024-09-10T23:05:30.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:30 smithi073 ceph-mon[35473]: pgmap v352: 129 pgs: 129 active+clean; 39 MiB data, 391 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:05:30.865 INFO:tasks.workunit.client.1.smithi073.stdout: 1 40613 2.66 MB/sec warmup 89 sec latency 18.396 ms 2024-09-10T23:05:31.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 231288 14.53 MB/sec warmup 87 sec latency 60.420 ms 2024-09-10T23:05:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:31.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:31.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 41113 2.63 MB/sec warmup 90 sec latency 16.011 ms 2024-09-10T23:05:32.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 231407 14.37 MB/sec warmup 88 sec latency 400.367 ms 2024-09-10T23:05:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:32 smithi046 ceph-mon[28128]: pgmap v353: 129 pgs: 129 active+clean; 40 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:05:32.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:32 smithi073 ceph-mon[35473]: pgmap v353: 129 pgs: 129 active+clean; 40 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:05:32.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 41555 2.63 MB/sec warmup 91 sec latency 17.087 ms 2024-09-10T23:05:33.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 234836 14.42 MB/sec warmup 89 sec latency 66.924 ms 2024-09-10T23:05:33.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 42333 2.67 MB/sec warmup 92 sec latency 15.747 ms 2024-09-10T23:05:34.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 238373 14.47 MB/sec warmup 90 sec latency 41.680 ms 2024-09-10T23:05:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:34 smithi046 ceph-mon[28128]: pgmap v354: 129 pgs: 129 active+clean; 40 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-09-10T23:05:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:34 smithi073 ceph-mon[35473]: pgmap v354: 129 pgs: 129 active+clean; 40 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-09-10T23:05:34.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 42662 2.68 MB/sec warmup 93 sec latency 17.504 ms 2024-09-10T23:05:35.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 240890 14.46 MB/sec warmup 91 sec latency 39.442 ms 2024-09-10T23:05:35.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 43005 2.66 MB/sec warmup 94 sec latency 13.969 ms 2024-09-10T23:05:36.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 243657 14.44 MB/sec warmup 92 sec latency 58.874 ms 2024-09-10T23:05:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:36 smithi046 ceph-mon[28128]: pgmap v355: 129 pgs: 129 active+clean; 41 MiB data, 403 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 69 op/s 2024-09-10T23:05:36.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:36 smithi073 ceph-mon[35473]: pgmap v355: 129 pgs: 129 active+clean; 41 MiB data, 403 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 69 op/s 2024-09-10T23:05:36.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 43385 2.64 MB/sec warmup 95 sec latency 17.114 ms 2024-09-10T23:05:37.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 245592 14.42 MB/sec warmup 93 sec latency 369.576 ms 2024-09-10T23:05:37.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 43835 2.63 MB/sec warmup 96 sec latency 18.498 ms 2024-09-10T23:05:38.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 249062 14.47 MB/sec warmup 94 sec latency 421.618 ms 2024-09-10T23:05:38.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:38 smithi046 ceph-mon[28128]: pgmap v356: 129 pgs: 129 active+clean; 41 MiB data, 404 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-09-10T23:05:38.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:38 smithi073 ceph-mon[35473]: pgmap v356: 129 pgs: 129 active+clean; 41 MiB data, 404 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-09-10T23:05:38.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 44375 2.64 MB/sec warmup 97 sec latency 18.533 ms 2024-09-10T23:05:39.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 252556 14.51 MB/sec warmup 95 sec latency 49.964 ms 2024-09-10T23:05:39.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 44899 2.63 MB/sec warmup 98 sec latency 16.458 ms 2024-09-10T23:05:40.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 254358 14.44 MB/sec warmup 96 sec latency 107.400 ms 2024-09-10T23:05:40.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:40 smithi046 ceph-mon[28128]: pgmap v357: 129 pgs: 129 active+clean; 41 MiB data, 403 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 51 op/s 2024-09-10T23:05:40.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:40 smithi073 ceph-mon[35473]: pgmap v357: 129 pgs: 129 active+clean; 41 MiB data, 403 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 51 op/s 2024-09-10T23:05:40.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 45356 2.64 MB/sec warmup 99 sec latency 18.851 ms 2024-09-10T23:05:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 257313 14.47 MB/sec warmup 97 sec latency 50.084 ms 2024-09-10T23:05:41.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 45913 2.65 MB/sec warmup 100 sec latency 17.131 ms 2024-09-10T23:05:42.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 259779 14.46 MB/sec warmup 98 sec latency 158.373 ms 2024-09-10T23:05:42.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:42 smithi046 ceph-mon[28128]: pgmap v358: 129 pgs: 129 active+clean; 41 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:05:42.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:42 smithi073 ceph-mon[35473]: pgmap v358: 129 pgs: 129 active+clean; 41 MiB data, 390 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:05:42.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 46371 2.67 MB/sec warmup 101 sec latency 17.483 ms 2024-09-10T23:05:43.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 259779 14.32 MB/sec warmup 99 sec latency 1100.639 ms 2024-09-10T23:05:43.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 46635 2.64 MB/sec warmup 102 sec latency 17.695 ms 2024-09-10T23:05:44.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 259779 14.17 MB/sec warmup 100 sec latency 2100.687 ms 2024-09-10T23:05:44.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:44 smithi046 ceph-mon[28128]: pgmap v359: 129 pgs: 129 active+clean; 40 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-09-10T23:05:44.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:44 smithi073 ceph-mon[35473]: pgmap v359: 129 pgs: 129 active+clean; 40 MiB data, 393 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-09-10T23:05:44.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 47085 2.63 MB/sec warmup 103 sec latency 16.812 ms 2024-09-10T23:05:45.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 259779 14.03 MB/sec warmup 101 sec latency 3100.799 ms 2024-09-10T23:05:45.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 47595 2.64 MB/sec warmup 104 sec latency 19.470 ms 2024-09-10T23:05:46.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 263189 14.08 MB/sec warmup 102 sec latency 3317.065 ms 2024-09-10T23:05:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:46 smithi046 ceph-mon[28128]: pgmap v360: 129 pgs: 129 active+clean; 43 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:05:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:46 smithi073 ceph-mon[35473]: pgmap v360: 129 pgs: 129 active+clean; 43 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:05:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:05:46.866 INFO:tasks.workunit.client.1.smithi073.stdout: 1 48051 2.62 MB/sec warmup 105 sec latency 18.805 ms 2024-09-10T23:05:47.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 265278 14.05 MB/sec warmup 103 sec latency 90.788 ms 2024-09-10T23:05:47.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 48546 2.61 MB/sec warmup 106 sec latency 16.448 ms 2024-09-10T23:05:48.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 267950 14.04 MB/sec warmup 104 sec latency 83.487 ms 2024-09-10T23:05:48.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:48 smithi046 ceph-mon[28128]: pgmap v361: 129 pgs: 129 active+clean; 43 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:05:48.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:48 smithi073 ceph-mon[35473]: pgmap v361: 129 pgs: 129 active+clean; 43 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:05:48.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 49137 2.64 MB/sec warmup 107 sec latency 17.496 ms 2024-09-10T23:05:49.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 271240 14.09 MB/sec warmup 105 sec latency 68.185 ms 2024-09-10T23:05:49.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 49533 2.63 MB/sec warmup 108 sec latency 18.830 ms 2024-09-10T23:05:50.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 274141 14.10 MB/sec warmup 106 sec latency 71.496 ms 2024-09-10T23:05:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:50 smithi046 ceph-mon[28128]: pgmap v362: 129 pgs: 129 active+clean; 44 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 58 op/s 2024-09-10T23:05:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:50 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:05:50.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:50 smithi073 ceph-mon[35473]: pgmap v362: 129 pgs: 129 active+clean; 44 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 58 op/s 2024-09-10T23:05:50.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:50 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:05:50.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 50014 2.65 MB/sec warmup 109 sec latency 14.871 ms 2024-09-10T23:05:51.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 275630 14.03 MB/sec warmup 107 sec latency 608.916 ms 2024-09-10T23:05:51.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 50305 2.62 MB/sec warmup 110 sec latency 49.139 ms 2024-09-10T23:05:52.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:05:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:05:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:05:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:05:52.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:51 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:05:52.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:05:52.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:05:52.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:05:52.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:05:52.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:51 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:05:52.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 279071 14.07 MB/sec warmup 108 sec latency 44.865 ms 2024-09-10T23:05:52.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 50764 2.62 MB/sec warmup 111 sec latency 30.531 ms 2024-09-10T23:05:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:52 smithi046 ceph-mon[28128]: pgmap v363: 129 pgs: 129 active+clean; 44 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-09-10T23:05:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:52 smithi073 ceph-mon[35473]: pgmap v363: 129 pgs: 129 active+clean; 44 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-09-10T23:05:53.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 282134 14.10 MB/sec warmup 109 sec latency 57.207 ms 2024-09-10T23:05:53.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 51274 2.62 MB/sec warmup 112 sec latency 20.364 ms 2024-09-10T23:05:54.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 284774 14.11 MB/sec warmup 110 sec latency 50.119 ms 2024-09-10T23:05:54.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 51771 2.60 MB/sec warmup 113 sec latency 18.904 ms 2024-09-10T23:05:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:54 smithi046 ceph-mon[28128]: pgmap v364: 129 pgs: 129 active+clean; 44 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:05:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:54 smithi073 ceph-mon[35473]: pgmap v364: 129 pgs: 129 active+clean; 44 MiB data, 396 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:05:55.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 288142 14.15 MB/sec warmup 111 sec latency 58.458 ms 2024-09-10T23:05:55.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 52243 2.60 MB/sec warmup 114 sec latency 16.768 ms 2024-09-10T23:05:56.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 290528 14.14 MB/sec warmup 112 sec latency 371.771 ms 2024-09-10T23:05:56.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 52973 2.64 MB/sec warmup 115 sec latency 15.916 ms 2024-09-10T23:05:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:56 smithi046 ceph-mon[28128]: pgmap v365: 129 pgs: 129 active+clean; 44 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-09-10T23:05:57.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:56 smithi073 ceph-mon[35473]: pgmap v365: 129 pgs: 129 active+clean; 44 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-09-10T23:05:57.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 291799 14.07 MB/sec warmup 113 sec latency 689.249 ms 2024-09-10T23:05:57.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 53318 2.64 MB/sec warmup 116 sec latency 19.905 ms 2024-09-10T23:05:58.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 295229 14.11 MB/sec warmup 114 sec latency 53.430 ms 2024-09-10T23:05:58.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 53647 2.63 MB/sec warmup 117 sec latency 21.605 ms 2024-09-10T23:05:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:05:58 smithi046 ceph-mon[28128]: pgmap v366: 129 pgs: 129 active+clean; 44 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-10T23:05:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:05:58 smithi073 ceph-mon[35473]: pgmap v366: 129 pgs: 129 active+clean; 44 MiB data, 397 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-10T23:05:59.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 298708 14.15 MB/sec warmup 115 sec latency 50.349 ms 2024-09-10T23:05:59.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 54027 2.61 MB/sec warmup 118 sec latency 17.181 ms 2024-09-10T23:06:00.650 INFO:tasks.workunit.client.0.smithi046.stdout: 1 302199 14.19 MB/sec warmup 116 sec latency 83.368 ms 2024-09-10T23:06:00.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 54457 2.60 MB/sec warmup 119 sec latency 20.582 ms 2024-09-10T23:06:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:00 smithi046 ceph-mon[28128]: pgmap v367: 129 pgs: 129 active+clean; 44 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-09-10T23:06:01.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:00 smithi073 ceph-mon[35473]: pgmap v367: 129 pgs: 129 active+clean; 44 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-09-10T23:06:01.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 304717 14.19 MB/sec warmup 117 sec latency 50.070 ms 2024-09-10T23:06:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:02.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 305749 14.12 MB/sec warmup 118 sec latency 668.896 ms 2024-09-10T23:06:02.867 INFO:tasks.workunit.client.1.smithi073.stdout: 1 55453 0.54 MB/sec execute 1 sec latency 24.548 ms 2024-09-10T23:06:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:02 smithi046 ceph-mon[28128]: pgmap v368: 129 pgs: 129 active+clean; 47 MiB data, 439 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-10T23:06:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:02 smithi073 ceph-mon[35473]: pgmap v368: 129 pgs: 129 active+clean; 47 MiB data, 439 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-10T23:06:03.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 307544 14.06 MB/sec warmup 119 sec latency 698.868 ms 2024-09-10T23:06:03.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 55955 2.85 MB/sec execute 2 sec latency 16.755 ms 2024-09-10T23:06:04.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 56546 3.05 MB/sec execute 3 sec latency 16.395 ms 2024-09-10T23:06:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:04 smithi046 ceph-mon[28128]: pgmap v369: 129 pgs: 129 active+clean; 46 MiB data, 439 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1019 KiB/s wr, 55 op/s 2024-09-10T23:06:05.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:04 smithi073 ceph-mon[35473]: pgmap v369: 129 pgs: 129 active+clean; 46 MiB data, 439 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1019 KiB/s wr, 55 op/s 2024-09-10T23:06:05.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 313145 14.65 MB/sec execute 1 sec latency 66.993 ms 2024-09-10T23:06:05.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 56982 3.38 MB/sec execute 4 sec latency 19.479 ms 2024-09-10T23:06:06.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 316514 16.67 MB/sec execute 2 sec latency 46.645 ms 2024-09-10T23:06:06.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 57252 2.77 MB/sec execute 5 sec latency 16.509 ms 2024-09-10T23:06:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:06 smithi046 ceph-mon[28128]: pgmap v370: 129 pgs: 129 active+clean; 46 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:06:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:06 smithi073 ceph-mon[35473]: pgmap v370: 129 pgs: 129 active+clean; 46 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:06:07.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 319932 17.39 MB/sec execute 3 sec latency 159.154 ms 2024-09-10T23:06:07.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 57561 2.38 MB/sec execute 6 sec latency 249.232 ms 2024-09-10T23:06:08.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 320170 13.19 MB/sec execute 4 sec latency 508.502 ms 2024-09-10T23:06:08.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 57998 2.28 MB/sec execute 7 sec latency 19.020 ms 2024-09-10T23:06:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:08 smithi046 ceph-mon[28128]: pgmap v371: 129 pgs: 129 active+clean; 47 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 76 op/s 2024-09-10T23:06:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:08 smithi073 ceph-mon[35473]: pgmap v371: 129 pgs: 129 active+clean; 47 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 76 op/s 2024-09-10T23:06:09.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 323600 14.31 MB/sec execute 5 sec latency 53.673 ms 2024-09-10T23:06:09.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 58507 2.39 MB/sec execute 8 sec latency 19.745 ms 2024-09-10T23:06:10.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 327023 15.07 MB/sec execute 6 sec latency 108.105 ms 2024-09-10T23:06:10.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 59029 2.19 MB/sec execute 9 sec latency 19.903 ms 2024-09-10T23:06:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:10 smithi046 ceph-mon[28128]: pgmap v372: 129 pgs: 129 active+clean; 47 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:06:11.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:10 smithi073 ceph-mon[35473]: pgmap v372: 129 pgs: 129 active+clean; 47 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:06:11.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 329632 14.94 MB/sec execute 7 sec latency 108.593 ms 2024-09-10T23:06:11.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 59526 2.48 MB/sec execute 10 sec latency 16.606 ms 2024-09-10T23:06:12.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 332652 15.04 MB/sec execute 8 sec latency 50.147 ms 2024-09-10T23:06:12.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 60090 2.57 MB/sec execute 11 sec latency 18.434 ms 2024-09-10T23:06:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:12 smithi046 ceph-mon[28128]: pgmap v373: 129 pgs: 129 active+clean; 47 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:06:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:12 smithi073 ceph-mon[35473]: pgmap v373: 129 pgs: 129 active+clean; 47 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:06:13.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 334168 14.31 MB/sec execute 9 sec latency 529.996 ms 2024-09-10T23:06:13.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 60336 2.61 MB/sec execute 12 sec latency 381.422 ms 2024-09-10T23:06:14.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 336730 14.28 MB/sec execute 10 sec latency 691.842 ms 2024-09-10T23:06:14.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 60711 2.54 MB/sec execute 13 sec latency 16.345 ms 2024-09-10T23:06:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:14 smithi046 ceph-mon[28128]: pgmap v374: 129 pgs: 129 active+clean; 47 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 977 KiB/s wr, 55 op/s 2024-09-10T23:06:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:14 smithi073 ceph-mon[35473]: pgmap v374: 129 pgs: 129 active+clean; 47 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 977 KiB/s wr, 55 op/s 2024-09-10T23:06:15.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 339456 14.12 MB/sec execute 11 sec latency 123.598 ms 2024-09-10T23:06:15.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 61050 2.37 MB/sec execute 14 sec latency 22.426 ms 2024-09-10T23:06:16.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 342410 14.34 MB/sec execute 12 sec latency 44.367 ms 2024-09-10T23:06:16.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 61508 2.34 MB/sec execute 15 sec latency 19.111 ms 2024-09-10T23:06:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:16 smithi046 ceph-mon[28128]: pgmap v375: 129 pgs: 129 active+clean; 48 MiB data, 465 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:06:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:16 smithi073 ceph-mon[35473]: pgmap v375: 129 pgs: 129 active+clean; 48 MiB data, 465 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:06:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:17.651 INFO:tasks.workunit.client.0.smithi046.stdout: 1 345164 14.44 MB/sec execute 13 sec latency 41.093 ms 2024-09-10T23:06:17.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 62021 2.39 MB/sec execute 16 sec latency 24.742 ms 2024-09-10T23:06:18.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 348423 14.67 MB/sec execute 14 sec latency 74.983 ms 2024-09-10T23:06:18.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 62517 2.28 MB/sec execute 17 sec latency 15.437 ms 2024-09-10T23:06:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:18 smithi046 ceph-mon[28128]: pgmap v376: 129 pgs: 129 active+clean; 49 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:06:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:18 smithi073 ceph-mon[35473]: pgmap v376: 129 pgs: 129 active+clean; 49 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:06:19.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 349250 14.01 MB/sec execute 15 sec latency 707.409 ms 2024-09-10T23:06:19.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 62944 2.28 MB/sec execute 18 sec latency 41.165 ms 2024-09-10T23:06:20.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 352147 14.06 MB/sec execute 16 sec latency 52.344 ms 2024-09-10T23:06:20.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 63633 2.49 MB/sec execute 19 sec latency 16.448 ms 2024-09-10T23:06:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:20 smithi046 ceph-mon[28128]: pgmap v377: 129 pgs: 129 active+clean; 48 MiB data, 467 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 946 KiB/s wr, 51 op/s 2024-09-10T23:06:21.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:20 smithi073 ceph-mon[35473]: pgmap v377: 129 pgs: 129 active+clean; 48 MiB data, 467 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 946 KiB/s wr, 51 op/s 2024-09-10T23:06:21.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 355503 14.33 MB/sec execute 17 sec latency 56.756 ms 2024-09-10T23:06:21.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 64022 2.54 MB/sec execute 20 sec latency 19.846 ms 2024-09-10T23:06:22.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 358987 14.59 MB/sec execute 18 sec latency 56.364 ms 2024-09-10T23:06:22.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 64341 2.48 MB/sec execute 21 sec latency 17.401 ms 2024-09-10T23:06:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:22 smithi046 ceph-mon[28128]: pgmap v378: 129 pgs: 129 active+clean; 50 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:06:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:22 smithi073 ceph-mon[35473]: pgmap v378: 129 pgs: 129 active+clean; 50 MiB data, 468 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:06:23.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 362473 14.82 MB/sec execute 19 sec latency 41.794 ms 2024-09-10T23:06:23.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 64742 2.40 MB/sec execute 22 sec latency 19.052 ms 2024-09-10T23:06:24.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 364169 14.42 MB/sec execute 20 sec latency 244.034 ms 2024-09-10T23:06:24.868 INFO:tasks.workunit.client.1.smithi073.stdout: 1 65257 2.48 MB/sec execute 23 sec latency 19.315 ms 2024-09-10T23:06:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:24 smithi046 ceph-mon[28128]: pgmap v379: 129 pgs: 129 active+clean; 50 MiB data, 466 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:06:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:24 smithi073 ceph-mon[35473]: pgmap v379: 129 pgs: 129 active+clean; 50 MiB data, 466 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:06:25.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 366072 14.32 MB/sec execute 21 sec latency 582.539 ms 2024-09-10T23:06:25.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 65717 2.40 MB/sec execute 24 sec latency 19.570 ms 2024-09-10T23:06:26.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 369560 14.54 MB/sec execute 22 sec latency 50.034 ms 2024-09-10T23:06:26.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 66233 2.36 MB/sec execute 25 sec latency 15.928 ms 2024-09-10T23:06:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:26 smithi046 ceph-mon[28128]: pgmap v380: 129 pgs: 129 active+clean; 50 MiB data, 471 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:06:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:26 smithi073 ceph-mon[35473]: pgmap v380: 129 pgs: 129 active+clean; 50 MiB data, 471 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:06:27.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 372078 14.48 MB/sec execute 23 sec latency 53.565 ms 2024-09-10T23:06:27.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 66799 2.49 MB/sec execute 26 sec latency 15.943 ms 2024-09-10T23:06:28.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 374809 14.41 MB/sec execute 24 sec latency 57.360 ms 2024-09-10T23:06:28.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 67202 2.46 MB/sec execute 27 sec latency 17.696 ms 2024-09-10T23:06:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:28 smithi046 ceph-mon[28128]: pgmap v381: 129 pgs: 129 active+clean; 49 MiB data, 476 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:06:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:28 smithi073 ceph-mon[35473]: pgmap v381: 129 pgs: 129 active+clean; 49 MiB data, 476 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:06:29.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 377612 14.52 MB/sec execute 25 sec latency 61.576 ms 2024-09-10T23:06:29.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 67698 2.53 MB/sec execute 28 sec latency 16.579 ms 2024-09-10T23:06:30.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 379308 14.32 MB/sec execute 26 sec latency 369.388 ms 2024-09-10T23:06:30.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 67947 2.46 MB/sec execute 29 sec latency 83.005 ms 2024-09-10T23:06:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:30 smithi046 ceph-mon[28128]: pgmap v382: 129 pgs: 129 active+clean; 49 MiB data, 477 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 949 KiB/s wr, 59 op/s 2024-09-10T23:06:31.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:30 smithi073 ceph-mon[35473]: pgmap v382: 129 pgs: 129 active+clean; 49 MiB data, 477 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 949 KiB/s wr, 59 op/s 2024-09-10T23:06:31.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 381203 14.16 MB/sec execute 27 sec latency 572.762 ms 2024-09-10T23:06:31.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 68335 2.40 MB/sec execute 30 sec latency 202.437 ms 2024-09-10T23:06:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:32.652 INFO:tasks.workunit.client.0.smithi046.stdout: 1 384028 14.18 MB/sec execute 28 sec latency 49.477 ms 2024-09-10T23:06:32.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 68837 2.46 MB/sec execute 31 sec latency 20.900 ms 2024-09-10T23:06:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:32 smithi046 ceph-mon[28128]: pgmap v383: 129 pgs: 129 active+clean; 52 MiB data, 481 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-10T23:06:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:32 smithi073 ceph-mon[35473]: pgmap v383: 129 pgs: 129 active+clean; 52 MiB data, 481 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-10T23:06:33.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 387477 14.34 MB/sec execute 29 sec latency 51.375 ms 2024-09-10T23:06:33.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 69297 2.39 MB/sec execute 32 sec latency 19.873 ms 2024-09-10T23:06:34.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 390908 14.49 MB/sec execute 30 sec latency 65.892 ms 2024-09-10T23:06:34.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 69792 2.37 MB/sec execute 33 sec latency 19.250 ms 2024-09-10T23:06:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:34 smithi046 ceph-mon[28128]: pgmap v384: 129 pgs: 129 active+clean; 52 MiB data, 481 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:06:35.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:34 smithi073 ceph-mon[35473]: pgmap v384: 129 pgs: 129 active+clean; 52 MiB data, 481 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:06:35.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 393555 14.48 MB/sec execute 31 sec latency 91.761 ms 2024-09-10T23:06:35.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 70318 2.44 MB/sec execute 34 sec latency 151.492 ms 2024-09-10T23:06:36.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 394511 14.18 MB/sec execute 32 sec latency 683.251 ms 2024-09-10T23:06:36.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 70726 2.45 MB/sec execute 35 sec latency 398.153 ms 2024-09-10T23:06:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:36 smithi046 ceph-mon[28128]: pgmap v385: 129 pgs: 129 active+clean; 50 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-09-10T23:06:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:36 smithi073 ceph-mon[35473]: pgmap v385: 129 pgs: 129 active+clean; 50 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-09-10T23:06:37.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 397993 14.33 MB/sec execute 33 sec latency 54.375 ms 2024-09-10T23:06:37.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 71122 2.47 MB/sec execute 36 sec latency 16.774 ms 2024-09-10T23:06:38.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 400636 14.33 MB/sec execute 34 sec latency 48.650 ms 2024-09-10T23:06:38.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 71420 2.44 MB/sec execute 37 sec latency 15.006 ms 2024-09-10T23:06:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:38 smithi046 ceph-mon[28128]: pgmap v386: 129 pgs: 129 active+clean; 51 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:06:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:38 smithi073 ceph-mon[35473]: pgmap v386: 129 pgs: 129 active+clean; 51 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:06:39.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 403337 14.27 MB/sec execute 35 sec latency 50.538 ms 2024-09-10T23:06:39.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 71835 2.39 MB/sec execute 38 sec latency 20.633 ms 2024-09-10T23:06:40.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 406290 14.34 MB/sec execute 36 sec latency 50.886 ms 2024-09-10T23:06:40.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 72347 2.45 MB/sec execute 39 sec latency 18.450 ms 2024-09-10T23:06:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:40 smithi046 ceph-mon[28128]: pgmap v387: 129 pgs: 129 active+clean; 52 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1021 KiB/s wr, 54 op/s 2024-09-10T23:06:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:40 smithi073 ceph-mon[35473]: pgmap v387: 129 pgs: 129 active+clean; 52 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1021 KiB/s wr, 54 op/s 2024-09-10T23:06:41.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 408683 14.33 MB/sec execute 37 sec latency 369.174 ms 2024-09-10T23:06:41.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 72802 2.39 MB/sec execute 40 sec latency 30.046 ms 2024-09-10T23:06:42.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 409839 14.09 MB/sec execute 38 sec latency 864.695 ms 2024-09-10T23:06:42.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 73324 2.37 MB/sec execute 41 sec latency 17.094 ms 2024-09-10T23:06:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:42 smithi046 ceph-mon[28128]: pgmap v388: 129 pgs: 129 active+clean; 54 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:06:43.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:42 smithi073 ceph-mon[35473]: pgmap v388: 129 pgs: 129 active+clean; 54 MiB data, 501 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:06:43.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 412484 14.10 MB/sec execute 39 sec latency 49.633 ms 2024-09-10T23:06:43.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 73865 2.42 MB/sec execute 42 sec latency 19.894 ms 2024-09-10T23:06:44.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 415924 14.22 MB/sec execute 40 sec latency 45.455 ms 2024-09-10T23:06:44.869 INFO:tasks.workunit.client.1.smithi073.stdout: 1 74317 2.44 MB/sec execute 43 sec latency 18.934 ms 2024-09-10T23:06:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:44 smithi046 ceph-mon[28128]: pgmap v389: 129 pgs: 129 active+clean; 54 MiB data, 499 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1011 KiB/s wr, 53 op/s 2024-09-10T23:06:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:44 smithi073 ceph-mon[35473]: pgmap v389: 129 pgs: 129 active+clean; 54 MiB data, 499 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1011 KiB/s wr, 53 op/s 2024-09-10T23:06:45.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 419384 14.34 MB/sec execute 41 sec latency 43.387 ms 2024-09-10T23:06:45.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 74781 2.48 MB/sec execute 44 sec latency 17.685 ms 2024-09-10T23:06:46.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 422820 14.45 MB/sec execute 42 sec latency 56.572 ms 2024-09-10T23:06:46.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 75049 2.43 MB/sec execute 45 sec latency 17.924 ms 2024-09-10T23:06:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:46 smithi046 ceph-mon[28128]: pgmap v390: 129 pgs: 129 active+clean; 54 MiB data, 498 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-09-10T23:06:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:46 smithi073 ceph-mon[35473]: pgmap v390: 129 pgs: 129 active+clean; 54 MiB data, 498 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-09-10T23:06:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:06:47.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 422937 14.12 MB/sec execute 43 sec latency 627.624 ms 2024-09-10T23:06:47.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 75484 2.40 MB/sec execute 46 sec latency 17.980 ms 2024-09-10T23:06:48.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 426406 14.23 MB/sec execute 44 sec latency 633.527 ms 2024-09-10T23:06:48.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 75978 2.44 MB/sec execute 47 sec latency 19.545 ms 2024-09-10T23:06:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:48 smithi046 ceph-mon[28128]: pgmap v391: 129 pgs: 129 active+clean; 54 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:06:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:48 smithi073 ceph-mon[35473]: pgmap v391: 129 pgs: 129 active+clean; 54 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:06:49.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 429011 14.22 MB/sec execute 45 sec latency 66.120 ms 2024-09-10T23:06:49.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 76452 2.40 MB/sec execute 48 sec latency 19.950 ms 2024-09-10T23:06:50.653 INFO:tasks.workunit.client.0.smithi046.stdout: 1 431912 14.24 MB/sec execute 46 sec latency 75.187 ms 2024-09-10T23:06:50.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 76939 2.38 MB/sec execute 49 sec latency 18.215 ms 2024-09-10T23:06:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:50 smithi046 ceph-mon[28128]: pgmap v392: 129 pgs: 129 active+clean; 54 MiB data, 519 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-10T23:06:51.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:50 smithi073 ceph-mon[35473]: pgmap v392: 129 pgs: 129 active+clean; 54 MiB data, 519 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-10T23:06:51.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 433692 14.14 MB/sec execute 47 sec latency 111.381 ms 2024-09-10T23:06:51.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 77531 2.44 MB/sec execute 50 sec latency 20.747 ms 2024-09-10T23:06:52.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 437113 14.24 MB/sec execute 48 sec latency 123.973 ms 2024-09-10T23:06:52.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 77918 2.43 MB/sec execute 51 sec latency 19.281 ms 2024-09-10T23:06:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:52 smithi046 ceph-mon[28128]: pgmap v393: 129 pgs: 129 active+clean; 54 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:06:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:52 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:06:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:52 smithi073 ceph-mon[35473]: pgmap v393: 129 pgs: 129 active+clean; 54 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:06:53.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:52 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:06:53.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 437951 14.04 MB/sec execute 49 sec latency 650.209 ms 2024-09-10T23:06:53.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 78401 2.47 MB/sec execute 52 sec latency 18.190 ms 2024-09-10T23:06:54.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:53 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:06:54.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:53 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:06:54.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:53 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:06:54.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:53 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:06:54.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:53 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:06:54.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:53 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:06:54.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 440742 14.06 MB/sec execute 50 sec latency 58.422 ms 2024-09-10T23:06:54.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 78706 2.43 MB/sec execute 53 sec latency 16.205 ms 2024-09-10T23:06:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:54 smithi046 ceph-mon[28128]: pgmap v394: 129 pgs: 129 active+clean; 54 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 990 KiB/s wr, 55 op/s 2024-09-10T23:06:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:54 smithi073 ceph-mon[35473]: pgmap v394: 129 pgs: 129 active+clean; 54 MiB data, 520 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 990 KiB/s wr, 55 op/s 2024-09-10T23:06:55.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 444207 14.15 MB/sec execute 51 sec latency 48.718 ms 2024-09-10T23:06:55.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 79183 2.42 MB/sec execute 54 sec latency 19.348 ms 2024-09-10T23:06:56.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 447635 14.24 MB/sec execute 52 sec latency 102.046 ms 2024-09-10T23:06:56.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 79676 2.43 MB/sec execute 55 sec latency 24.139 ms 2024-09-10T23:06:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:56 smithi046 ceph-mon[28128]: pgmap v395: 129 pgs: 129 active+clean; 54 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 977 KiB/s wr, 62 op/s 2024-09-10T23:06:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:56 smithi073 ceph-mon[35473]: pgmap v395: 129 pgs: 129 active+clean; 54 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 977 KiB/s wr, 62 op/s 2024-09-10T23:06:57.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 451171 14.33 MB/sec execute 53 sec latency 45.558 ms 2024-09-10T23:06:57.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 80169 2.40 MB/sec execute 56 sec latency 18.862 ms 2024-09-10T23:06:58.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 451419 14.08 MB/sec execute 54 sec latency 375.304 ms 2024-09-10T23:06:58.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 80580 2.39 MB/sec execute 57 sec latency 83.649 ms 2024-09-10T23:06:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:06:58 smithi073 ceph-mon[35473]: pgmap v396: 129 pgs: 129 active+clean; 56 MiB data, 531 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:06:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:06:58 smithi046 ceph-mon[28128]: pgmap v396: 129 pgs: 129 active+clean; 56 MiB data, 531 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:06:59.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 454723 14.16 MB/sec execute 55 sec latency 349.604 ms 2024-09-10T23:06:59.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 81349 2.47 MB/sec execute 58 sec latency 20.295 ms 2024-09-10T23:07:00.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 457364 14.16 MB/sec execute 56 sec latency 54.992 ms 2024-09-10T23:07:00.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 81638 2.48 MB/sec execute 59 sec latency 18.776 ms 2024-09-10T23:07:01.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:00 smithi073 ceph-mon[35473]: pgmap v397: 129 pgs: 129 active+clean; 56 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 993 KiB/s wr, 57 op/s 2024-09-10T23:07:01.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:00 smithi046 ceph-mon[28128]: pgmap v397: 129 pgs: 129 active+clean; 56 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 993 KiB/s wr, 57 op/s 2024-09-10T23:07:01.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 459825 14.46 MB/sec execute 57 sec latency 91.166 ms 2024-09-10T23:07:01.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 82012 2.46 MB/sec execute 60 sec latency 16.146 ms 2024-09-10T23:07:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:02.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:02.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 462787 14.46 MB/sec execute 58 sec latency 52.732 ms 2024-09-10T23:07:02.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 82328 2.43 MB/sec execute 61 sec latency 21.873 ms 2024-09-10T23:07:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:02 smithi046 ceph-mon[28128]: pgmap v398: 129 pgs: 129 active+clean; 56 MiB data, 528 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-10T23:07:03.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:02 smithi073 ceph-mon[35473]: pgmap v398: 129 pgs: 129 active+clean; 56 MiB data, 528 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-10T23:07:03.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 466246 14.54 MB/sec execute 59 sec latency 40.778 ms 2024-09-10T23:07:03.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 82790 2.42 MB/sec execute 62 sec latency 26.712 ms 2024-09-10T23:07:04.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 466332 14.30 MB/sec execute 60 sec latency 557.506 ms 2024-09-10T23:07:04.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 83193 2.43 MB/sec execute 63 sec latency 216.677 ms 2024-09-10T23:07:05.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:04 smithi046 ceph-mon[28128]: pgmap v399: 129 pgs: 129 active+clean; 56 MiB data, 528 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 56 op/s 2024-09-10T23:07:05.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:04 smithi073 ceph-mon[35473]: pgmap v399: 129 pgs: 129 active+clean; 56 MiB data, 528 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 56 op/s 2024-09-10T23:07:05.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 469737 14.37 MB/sec execute 61 sec latency 291.947 ms 2024-09-10T23:07:05.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 83674 2.40 MB/sec execute 64 sec latency 18.525 ms 2024-09-10T23:07:06.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 473272 14.45 MB/sec execute 62 sec latency 52.188 ms 2024-09-10T23:07:06.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 84104 2.39 MB/sec execute 65 sec latency 17.515 ms 2024-09-10T23:07:07.230 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:06 smithi073 ceph-mon[35473]: pgmap v400: 129 pgs: 129 active+clean; 58 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:07:07.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:06 smithi046 ceph-mon[28128]: pgmap v400: 129 pgs: 129 active+clean; 58 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-09-10T23:07:07.654 INFO:tasks.workunit.client.0.smithi046.stdout: 1 476343 14.51 MB/sec execute 63 sec latency 55.916 ms 2024-09-10T23:07:07.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 84842 2.44 MB/sec execute 66 sec latency 14.588 ms 2024-09-10T23:07:08.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 479124 14.49 MB/sec execute 64 sec latency 54.343 ms 2024-09-10T23:07:08.870 INFO:tasks.workunit.client.1.smithi073.stdout: 1 85186 2.47 MB/sec execute 67 sec latency 16.448 ms 2024-09-10T23:07:09.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:08 smithi046 ceph-mon[28128]: pgmap v401: 129 pgs: 129 active+clean; 58 MiB data, 533 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.4 MiB/s wr, 73 op/s 2024-09-10T23:07:09.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:08 smithi073 ceph-mon[35473]: pgmap v401: 129 pgs: 129 active+clean; 58 MiB data, 533 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.4 MiB/s wr, 73 op/s 2024-09-10T23:07:09.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 480661 14.38 MB/sec execute 65 sec latency 219.456 ms 2024-09-10T23:07:09.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 85557 2.45 MB/sec execute 68 sec latency 21.833 ms 2024-09-10T23:07:10.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 482667 14.34 MB/sec execute 66 sec latency 582.790 ms 2024-09-10T23:07:10.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 85880 2.42 MB/sec execute 69 sec latency 18.193 ms 2024-09-10T23:07:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:10 smithi046 ceph-mon[28128]: pgmap v402: 129 pgs: 129 active+clean; 58 MiB data, 534 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:07:11.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:10 smithi073 ceph-mon[35473]: pgmap v402: 129 pgs: 129 active+clean; 58 MiB data, 534 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:07:11.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 485624 14.33 MB/sec execute 67 sec latency 33.685 ms 2024-09-10T23:07:11.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 86341 2.41 MB/sec execute 70 sec latency 20.160 ms 2024-09-10T23:07:12.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 487684 14.30 MB/sec execute 68 sec latency 117.647 ms 2024-09-10T23:07:12.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 86823 2.42 MB/sec execute 71 sec latency 21.255 ms 2024-09-10T23:07:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:12 smithi046 ceph-mon[28128]: pgmap v403: 129 pgs: 129 active+clean; 59 MiB data, 556 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:07:13.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:12 smithi073 ceph-mon[35473]: pgmap v403: 129 pgs: 129 active+clean; 59 MiB data, 556 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:07:13.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 491111 14.37 MB/sec execute 69 sec latency 49.225 ms 2024-09-10T23:07:13.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 87331 2.40 MB/sec execute 72 sec latency 19.689 ms 2024-09-10T23:07:14.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 494584 14.44 MB/sec execute 70 sec latency 53.866 ms 2024-09-10T23:07:14.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 87772 2.40 MB/sec execute 73 sec latency 22.508 ms 2024-09-10T23:07:15.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:14 smithi046 ceph-mon[28128]: pgmap v404: 129 pgs: 129 active+clean; 59 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:07:15.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:14 smithi073 ceph-mon[35473]: pgmap v404: 129 pgs: 129 active+clean; 59 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:07:15.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 494845 14.24 MB/sec execute 71 sec latency 440.460 ms 2024-09-10T23:07:15.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 88472 2.45 MB/sec execute 74 sec latency 16.160 ms 2024-09-10T23:07:16.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 498144 14.30 MB/sec execute 72 sec latency 300.213 ms 2024-09-10T23:07:16.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 88852 2.46 MB/sec execute 75 sec latency 16.647 ms 2024-09-10T23:07:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:16 smithi046 ceph-mon[28128]: pgmap v405: 129 pgs: 129 active+clean; 59 MiB data, 559 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:07:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:16 smithi073 ceph-mon[35473]: pgmap v405: 129 pgs: 129 active+clean; 59 MiB data, 559 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:07:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:17.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 501627 14.36 MB/sec execute 73 sec latency 100.001 ms 2024-09-10T23:07:17.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 89167 2.45 MB/sec execute 76 sec latency 16.723 ms 2024-09-10T23:07:18.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 505168 14.43 MB/sec execute 74 sec latency 52.665 ms 2024-09-10T23:07:18.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 89554 2.42 MB/sec execute 77 sec latency 18.500 ms 2024-09-10T23:07:19.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:18 smithi046 ceph-mon[28128]: pgmap v406: 129 pgs: 129 active+clean; 59 MiB data, 560 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:07:19.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:18 smithi073 ceph-mon[35473]: pgmap v406: 129 pgs: 129 active+clean; 59 MiB data, 560 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:07:19.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 507684 14.41 MB/sec execute 75 sec latency 56.583 ms 2024-09-10T23:07:19.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 90014 2.41 MB/sec execute 78 sec latency 17.141 ms 2024-09-10T23:07:20.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 509927 14.37 MB/sec execute 76 sec latency 91.163 ms 2024-09-10T23:07:20.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 90502 2.42 MB/sec execute 79 sec latency 99.971 ms 2024-09-10T23:07:21.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:20 smithi046 ceph-mon[28128]: pgmap v407: 129 pgs: 129 active+clean; 60 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:07:21.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:20 smithi073 ceph-mon[35473]: pgmap v407: 129 pgs: 129 active+clean; 60 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:07:21.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 511031 14.28 MB/sec execute 77 sec latency 686.510 ms 2024-09-10T23:07:21.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 90824 2.40 MB/sec execute 80 sec latency 371.957 ms 2024-09-10T23:07:22.655 INFO:tasks.workunit.client.0.smithi046.stdout: 1 513998 14.27 MB/sec execute 78 sec latency 58.389 ms 2024-09-10T23:07:22.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 91300 2.39 MB/sec execute 81 sec latency 16.470 ms 2024-09-10T23:07:23.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:22 smithi046 ceph-mon[28128]: pgmap v408: 129 pgs: 129 active+clean; 61 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:07:23.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:22 smithi073 ceph-mon[35473]: pgmap v408: 129 pgs: 129 active+clean; 61 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:07:23.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 517014 14.31 MB/sec execute 79 sec latency 50.072 ms 2024-09-10T23:07:23.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 92013 2.44 MB/sec execute 82 sec latency 17.168 ms 2024-09-10T23:07:24.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 519662 14.31 MB/sec execute 80 sec latency 49.981 ms 2024-09-10T23:07:24.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 92384 2.45 MB/sec execute 83 sec latency 18.644 ms 2024-09-10T23:07:25.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:24 smithi046 ceph-mon[28128]: pgmap v409: 129 pgs: 129 active+clean; 61 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 999 KiB/s wr, 56 op/s 2024-09-10T23:07:25.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:24 smithi073 ceph-mon[35473]: pgmap v409: 129 pgs: 129 active+clean; 61 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 999 KiB/s wr, 56 op/s 2024-09-10T23:07:25.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 523023 14.37 MB/sec execute 81 sec latency 42.659 ms 2024-09-10T23:07:25.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 92702 2.44 MB/sec execute 84 sec latency 19.614 ms 2024-09-10T23:07:26.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 526443 14.42 MB/sec execute 82 sec latency 316.935 ms 2024-09-10T23:07:26.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 92891 2.41 MB/sec execute 85 sec latency 359.421 ms 2024-09-10T23:07:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:26 smithi046 ceph-mon[28128]: pgmap v410: 129 pgs: 129 active+clean; 60 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2024-09-10T23:07:27.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:26 smithi073 ceph-mon[35473]: pgmap v410: 129 pgs: 129 active+clean; 60 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2024-09-10T23:07:27.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 526754 14.25 MB/sec execute 83 sec latency 675.205 ms 2024-09-10T23:07:27.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 93342 2.41 MB/sec execute 86 sec latency 21.755 ms 2024-09-10T23:07:28.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 530190 14.31 MB/sec execute 84 sec latency 55.414 ms 2024-09-10T23:07:28.871 INFO:tasks.workunit.client.1.smithi073.stdout: 1 93857 2.42 MB/sec execute 87 sec latency 15.671 ms 2024-09-10T23:07:29.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:28 smithi046 ceph-mon[28128]: pgmap v411: 129 pgs: 129 active+clean; 62 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 59 op/s 2024-09-10T23:07:29.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:28 smithi073 ceph-mon[35473]: pgmap v411: 129 pgs: 129 active+clean; 62 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 59 op/s 2024-09-10T23:07:29.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 533688 14.36 MB/sec execute 85 sec latency 48.627 ms 2024-09-10T23:07:29.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 94352 2.40 MB/sec execute 88 sec latency 17.970 ms 2024-09-10T23:07:30.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 537165 14.42 MB/sec execute 86 sec latency 46.340 ms 2024-09-10T23:07:30.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 94769 2.39 MB/sec execute 89 sec latency 18.761 ms 2024-09-10T23:07:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:30 smithi046 ceph-mon[28128]: pgmap v412: 129 pgs: 129 active+clean; 61 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-09-10T23:07:31.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:30 smithi073 ceph-mon[35473]: pgmap v412: 129 pgs: 129 active+clean; 61 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-09-10T23:07:31.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 540658 14.47 MB/sec execute 87 sec latency 52.214 ms 2024-09-10T23:07:31.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 95547 2.44 MB/sec execute 90 sec latency 16.169 ms 2024-09-10T23:07:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:31 smithi046 ceph-mon[28128]: pgmap v413: 129 pgs: 129 active+clean; 61 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-09-10T23:07:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:31 smithi073 ceph-mon[35473]: pgmap v413: 129 pgs: 129 active+clean; 61 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-09-10T23:07:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:32.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 540787 14.31 MB/sec execute 88 sec latency 371.752 ms 2024-09-10T23:07:32.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 95836 2.45 MB/sec execute 91 sec latency 27.777 ms 2024-09-10T23:07:33.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 543305 14.31 MB/sec execute 89 sec latency 683.673 ms 2024-09-10T23:07:33.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 96213 2.44 MB/sec execute 92 sec latency 17.245 ms 2024-09-10T23:07:34.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:34 smithi046 ceph-mon[28128]: pgmap v414: 129 pgs: 129 active+clean; 61 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 962 KiB/s wr, 54 op/s 2024-09-10T23:07:34.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:34 smithi073 ceph-mon[35473]: pgmap v414: 129 pgs: 129 active+clean; 61 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 962 KiB/s wr, 54 op/s 2024-09-10T23:07:34.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 546493 14.34 MB/sec execute 90 sec latency 58.472 ms 2024-09-10T23:07:34.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 96572 2.42 MB/sec execute 93 sec latency 20.430 ms 2024-09-10T23:07:35.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 548964 14.31 MB/sec execute 91 sec latency 54.987 ms 2024-09-10T23:07:35.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 97033 2.41 MB/sec execute 94 sec latency 16.748 ms 2024-09-10T23:07:36.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:36 smithi073 ceph-mon[35473]: pgmap v415: 129 pgs: 129 active+clean; 63 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-09-10T23:07:36.535 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:36 smithi046 ceph-mon[28128]: pgmap v415: 129 pgs: 129 active+clean; 63 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-09-10T23:07:36.656 INFO:tasks.workunit.client.0.smithi046.stdout: 1 551606 14.32 MB/sec execute 92 sec latency 52.926 ms 2024-09-10T23:07:36.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 97558 2.42 MB/sec execute 95 sec latency 16.835 ms 2024-09-10T23:07:37.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 554970 14.36 MB/sec execute 93 sec latency 72.421 ms 2024-09-10T23:07:37.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 98110 2.41 MB/sec execute 96 sec latency 17.375 ms 2024-09-10T23:07:38.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:38 smithi046 ceph-mon[28128]: pgmap v416: 129 pgs: 129 active+clean; 65 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 MiB/s wr, 60 op/s 2024-09-10T23:07:38.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:38 smithi073 ceph-mon[35473]: pgmap v416: 129 pgs: 129 active+clean; 65 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 MiB/s wr, 60 op/s 2024-09-10T23:07:38.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 555648 14.26 MB/sec execute 94 sec latency 645.009 ms 2024-09-10T23:07:38.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 98576 2.43 MB/sec execute 97 sec latency 23.899 ms 2024-09-10T23:07:39.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 558629 14.27 MB/sec execute 95 sec latency 44.358 ms 2024-09-10T23:07:39.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 99127 2.44 MB/sec execute 98 sec latency 19.441 ms 2024-09-10T23:07:40.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:40 smithi046 ceph-mon[28128]: pgmap v417: 129 pgs: 129 active+clean; 65 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 980 KiB/s wr, 59 op/s 2024-09-10T23:07:40.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:40 smithi073 ceph-mon[35473]: pgmap v417: 129 pgs: 129 active+clean; 65 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 980 KiB/s wr, 59 op/s 2024-09-10T23:07:40.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 562061 14.31 MB/sec execute 96 sec latency 57.379 ms 2024-09-10T23:07:40.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 99572 2.46 MB/sec execute 99 sec latency 18.884 ms 2024-09-10T23:07:41.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 565529 14.36 MB/sec execute 97 sec latency 125.222 ms 2024-09-10T23:07:41.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 99840 2.43 MB/sec execute 100 sec latency 16.886 ms 2024-09-10T23:07:42.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:42 smithi046 ceph-mon[28128]: pgmap v418: 129 pgs: 129 active+clean; 65 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-10T23:07:42.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:42 smithi073 ceph-mon[35473]: pgmap v418: 129 pgs: 129 active+clean; 65 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-10T23:07:42.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 568123 14.36 MB/sec execute 98 sec latency 125.216 ms 2024-09-10T23:07:42.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 100269 2.42 MB/sec execute 101 sec latency 19.163 ms 2024-09-10T23:07:43.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 569271 14.27 MB/sec execute 99 sec latency 332.800 ms 2024-09-10T23:07:43.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 100752 2.44 MB/sec execute 102 sec latency 18.144 ms 2024-09-10T23:07:44.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:44 smithi046 ceph-mon[28128]: pgmap v419: 129 pgs: 129 active+clean; 65 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:07:44.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:44 smithi073 ceph-mon[35473]: pgmap v419: 129 pgs: 129 active+clean; 65 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:07:44.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 572555 14.31 MB/sec execute 100 sec latency 769.056 ms 2024-09-10T23:07:44.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 101225 2.42 MB/sec execute 103 sec latency 21.526 ms 2024-09-10T23:07:45.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 575181 14.31 MB/sec execute 101 sec latency 50.142 ms 2024-09-10T23:07:45.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 101723 2.41 MB/sec execute 104 sec latency 18.863 ms 2024-09-10T23:07:46.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:46 smithi073 ceph-mon[35473]: pgmap v420: 129 pgs: 129 active+clean; 65 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:07:46.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:46 smithi046 ceph-mon[28128]: pgmap v420: 129 pgs: 129 active+clean; 65 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:07:46.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 578202 14.32 MB/sec execute 102 sec latency 58.535 ms 2024-09-10T23:07:46.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 102274 2.44 MB/sec execute 105 sec latency 19.803 ms 2024-09-10T23:07:47.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:47.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:07:47.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 580615 14.31 MB/sec execute 103 sec latency 76.218 ms 2024-09-10T23:07:47.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 102688 2.43 MB/sec execute 106 sec latency 18.674 ms 2024-09-10T23:07:48.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:48 smithi046 ceph-mon[28128]: pgmap v421: 129 pgs: 129 active+clean; 65 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 70 op/s 2024-09-10T23:07:48.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:48 smithi073 ceph-mon[35473]: pgmap v421: 129 pgs: 129 active+clean; 65 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 70 op/s 2024-09-10T23:07:48.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 583450 14.32 MB/sec execute 104 sec latency 46.854 ms 2024-09-10T23:07:48.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 103172 2.45 MB/sec execute 107 sec latency 16.306 ms 2024-09-10T23:07:49.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 584425 14.23 MB/sec execute 105 sec latency 583.462 ms 2024-09-10T23:07:49.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 103438 2.43 MB/sec execute 108 sec latency 21.809 ms 2024-09-10T23:07:50.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:50 smithi046 ceph-mon[28128]: pgmap v422: 129 pgs: 129 active+clean; 66 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:07:50.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:50 smithi073 ceph-mon[35473]: pgmap v422: 129 pgs: 129 active+clean; 66 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:07:50.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 587559 14.27 MB/sec execute 106 sec latency 59.298 ms 2024-09-10T23:07:50.872 INFO:tasks.workunit.client.1.smithi073.stdout: 1 103874 2.42 MB/sec execute 109 sec latency 19.645 ms 2024-09-10T23:07:51.657 INFO:tasks.workunit.client.0.smithi046.stdout: 1 590507 14.27 MB/sec execute 107 sec latency 46.882 ms 2024-09-10T23:07:51.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 104385 2.43 MB/sec execute 110 sec latency 21.155 ms 2024-09-10T23:07:52.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:52 smithi046 ceph-mon[28128]: pgmap v423: 129 pgs: 129 active+clean; 67 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:07:52.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:52 smithi073 ceph-mon[35473]: pgmap v423: 129 pgs: 129 active+clean; 67 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:07:52.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 593967 14.32 MB/sec execute 108 sec latency 70.285 ms 2024-09-10T23:07:52.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 104869 2.41 MB/sec execute 111 sec latency 16.465 ms 2024-09-10T23:07:53.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 597449 14.36 MB/sec execute 109 sec latency 71.749 ms 2024-09-10T23:07:53.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 105330 2.41 MB/sec execute 112 sec latency 16.996 ms 2024-09-10T23:07:54.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:54 smithi046 ceph-mon[28128]: pgmap v424: 129 pgs: 129 active+clean; 67 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1008 KiB/s wr, 53 op/s 2024-09-10T23:07:54.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:54 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:07:54.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:54 smithi073 ceph-mon[35473]: pgmap v424: 129 pgs: 129 active+clean; 67 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1008 KiB/s wr, 53 op/s 2024-09-10T23:07:54.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:54 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:07:54.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 600931 14.40 MB/sec execute 110 sec latency 139.526 ms 2024-09-10T23:07:54.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 105901 2.43 MB/sec execute 113 sec latency 46.298 ms 2024-09-10T23:07:55.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:07:55.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:07:55.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:07:55.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:07:55.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:07:55.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:07:55.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 601060 14.27 MB/sec execute 111 sec latency 771.969 ms 2024-09-10T23:07:55.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 106231 2.43 MB/sec execute 114 sec latency 315.188 ms 2024-09-10T23:07:56.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 604492 14.31 MB/sec execute 112 sec latency 91.877 ms 2024-09-10T23:07:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:56 smithi046 ceph-mon[28128]: pgmap v425: 129 pgs: 129 active+clean; 66 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 986 KiB/s wr, 61 op/s 2024-09-10T23:07:56.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:56 smithi073 ceph-mon[35473]: pgmap v425: 129 pgs: 129 active+clean; 66 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 986 KiB/s wr, 61 op/s 2024-09-10T23:07:56.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 106711 2.45 MB/sec execute 115 sec latency 17.369 ms 2024-09-10T23:07:57.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 608023 14.36 MB/sec execute 113 sec latency 49.542 ms 2024-09-10T23:07:57.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 106985 2.43 MB/sec execute 116 sec latency 17.850 ms 2024-09-10T23:07:58.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 610343 14.34 MB/sec execute 114 sec latency 50.451 ms 2024-09-10T23:07:58.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:07:58 smithi046 ceph-mon[28128]: pgmap v426: 129 pgs: 129 active+clean; 66 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2024-09-10T23:07:58.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:07:58 smithi073 ceph-mon[35473]: pgmap v426: 129 pgs: 129 active+clean; 66 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2024-09-10T23:07:58.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 107431 2.41 MB/sec execute 117 sec latency 16.408 ms 2024-09-10T23:07:59.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 613271 14.33 MB/sec execute 115 sec latency 54.051 ms 2024-09-10T23:07:59.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 107947 2.43 MB/sec execute 118 sec latency 15.402 ms 2024-09-10T23:08:00.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 616077 14.36 MB/sec execute 116 sec latency 45.039 ms 2024-09-10T23:08:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:00 smithi046 ceph-mon[28128]: pgmap v427: 129 pgs: 129 active+clean; 68 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:08:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:00 smithi073 ceph-mon[35473]: pgmap v427: 129 pgs: 129 active+clean; 68 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:08:00.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 108431 2.41 MB/sec execute 119 sec latency 22.198 ms 2024-09-10T23:08:01.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 618910 14.36 MB/sec execute 117 sec latency 58.473 ms 2024-09-10T23:08:01.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:01.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:01.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 108887 2.41 MB/sec execute 120 sec latency 18.589 ms 2024-09-10T23:08:02.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 622333 14.40 MB/sec execute 118 sec latency 56.925 ms 2024-09-10T23:08:02.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:02 smithi046 ceph-mon[28128]: pgmap v428: 129 pgs: 129 active+clean; 69 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:08:02.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:02 smithi073 ceph-mon[35473]: pgmap v428: 129 pgs: 129 active+clean; 69 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:08:02.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 109473 2.43 MB/sec execute 121 sec latency 25.046 ms 2024-09-10T23:08:03.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 625814 14.44 MB/sec execute 119 sec latency 58.930 ms 2024-09-10T23:08:03.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 109943 2.45 MB/sec execute 122 sec latency 16.803 ms 2024-09-10T23:08:04.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 629188 14.47 MB/sec execute 120 sec latency 89.595 ms 2024-09-10T23:08:04.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:04 smithi046 ceph-mon[28128]: pgmap v429: 129 pgs: 129 active+clean; 69 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1012 KiB/s wr, 55 op/s 2024-09-10T23:08:04.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:04 smithi073 ceph-mon[35473]: pgmap v429: 129 pgs: 129 active+clean; 69 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1012 KiB/s wr, 55 op/s 2024-09-10T23:08:04.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 110337 2.44 MB/sec execute 123 sec latency 19.195 ms 2024-09-10T23:08:05.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 631813 14.46 MB/sec execute 121 sec latency 49.983 ms 2024-09-10T23:08:05.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 110655 2.43 MB/sec execute 124 sec latency 18.954 ms 2024-09-10T23:08:06.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 634584 14.45 MB/sec execute 122 sec latency 57.856 ms 2024-09-10T23:08:06.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:06 smithi046 ceph-mon[28128]: pgmap v430: 129 pgs: 129 active+clean; 68 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:08:06.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:06 smithi073 ceph-mon[35473]: pgmap v430: 129 pgs: 129 active+clean; 68 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:08:06.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 111122 2.42 MB/sec execute 125 sec latency 17.801 ms 2024-09-10T23:08:07.658 INFO:tasks.workunit.client.0.smithi046.stdout: 1 637350 14.47 MB/sec execute 123 sec latency 56.285 ms 2024-09-10T23:08:07.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 111609 2.43 MB/sec execute 126 sec latency 23.389 ms 2024-09-10T23:08:08.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 640069 14.47 MB/sec execute 124 sec latency 133.425 ms 2024-09-10T23:08:08.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:08 smithi046 ceph-mon[28128]: pgmap v431: 129 pgs: 129 active+clean; 70 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 71 op/s 2024-09-10T23:08:08.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:08 smithi073 ceph-mon[35473]: pgmap v431: 129 pgs: 129 active+clean; 70 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 71 op/s 2024-09-10T23:08:08.873 INFO:tasks.workunit.client.1.smithi073.stdout: 1 112086 2.41 MB/sec execute 127 sec latency 17.547 ms 2024-09-10T23:08:09.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 643541 14.51 MB/sec execute 125 sec latency 52.286 ms 2024-09-10T23:08:09.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 112559 2.41 MB/sec execute 128 sec latency 16.619 ms 2024-09-10T23:08:10.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 647035 14.54 MB/sec execute 126 sec latency 50.205 ms 2024-09-10T23:08:10.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:10 smithi046 ceph-mon[28128]: pgmap v432: 129 pgs: 129 active+clean; 69 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:08:10.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:10 smithi073 ceph-mon[35473]: pgmap v432: 129 pgs: 129 active+clean; 69 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:08:10.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 113280 2.44 MB/sec execute 129 sec latency 23.776 ms 2024-09-10T23:08:11.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 650567 14.58 MB/sec execute 127 sec latency 46.309 ms 2024-09-10T23:08:11.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 113628 2.45 MB/sec execute 130 sec latency 17.361 ms 2024-09-10T23:08:12.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 652309 14.52 MB/sec execute 128 sec latency 101.083 ms 2024-09-10T23:08:12.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:12 smithi046 ceph-mon[28128]: pgmap v433: 129 pgs: 129 active+clean; 69 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2024-09-10T23:08:12.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:12 smithi073 ceph-mon[35473]: pgmap v433: 129 pgs: 129 active+clean; 69 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2024-09-10T23:08:12.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 113957 2.44 MB/sec execute 131 sec latency 20.154 ms 2024-09-10T23:08:13.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 655080 14.54 MB/sec execute 129 sec latency 47.966 ms 2024-09-10T23:08:13.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 114314 2.43 MB/sec execute 132 sec latency 22.315 ms 2024-09-10T23:08:14.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 657866 14.54 MB/sec execute 130 sec latency 124.921 ms 2024-09-10T23:08:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:14 smithi046 ceph-mon[28128]: pgmap v434: 129 pgs: 129 active+clean; 69 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1011 KiB/s wr, 56 op/s 2024-09-10T23:08:14.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:14 smithi073 ceph-mon[35473]: pgmap v434: 129 pgs: 129 active+clean; 69 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1011 KiB/s wr, 56 op/s 2024-09-10T23:08:14.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 114765 2.42 MB/sec execute 133 sec latency 20.753 ms 2024-09-10T23:08:15.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 661330 14.58 MB/sec execute 131 sec latency 50.121 ms 2024-09-10T23:08:15.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 115260 2.43 MB/sec execute 134 sec latency 21.853 ms 2024-09-10T23:08:16.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 662170 14.50 MB/sec execute 132 sec latency 652.051 ms 2024-09-10T23:08:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:16 smithi046 ceph-mon[28128]: pgmap v435: 129 pgs: 129 active+clean; 71 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:08:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:16 smithi073 ceph-mon[35473]: pgmap v435: 129 pgs: 129 active+clean; 71 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:08:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:16.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 115642 2.41 MB/sec execute 135 sec latency 238.446 ms 2024-09-10T23:08:17.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 664815 14.50 MB/sec execute 133 sec latency 675.434 ms 2024-09-10T23:08:17.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 116114 2.41 MB/sec execute 136 sec latency 16.270 ms 2024-09-10T23:08:18.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 668308 14.53 MB/sec execute 134 sec latency 48.967 ms 2024-09-10T23:08:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:18 smithi046 ceph-mon[28128]: pgmap v436: 129 pgs: 129 active+clean; 71 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 72 op/s 2024-09-10T23:08:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:18 smithi073 ceph-mon[35473]: pgmap v436: 129 pgs: 129 active+clean; 71 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 72 op/s 2024-09-10T23:08:18.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 116830 2.44 MB/sec execute 137 sec latency 15.590 ms 2024-09-10T23:08:19.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 670957 14.53 MB/sec execute 135 sec latency 48.280 ms 2024-09-10T23:08:19.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 117161 2.45 MB/sec execute 138 sec latency 21.238 ms 2024-09-10T23:08:20.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 674198 14.55 MB/sec execute 136 sec latency 40.496 ms 2024-09-10T23:08:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:20 smithi046 ceph-mon[28128]: pgmap v437: 129 pgs: 129 active+clean; 70 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1013 KiB/s wr, 59 op/s 2024-09-10T23:08:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:20 smithi073 ceph-mon[35473]: pgmap v437: 129 pgs: 129 active+clean; 70 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1013 KiB/s wr, 59 op/s 2024-09-10T23:08:20.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 117485 2.44 MB/sec execute 139 sec latency 18.324 ms 2024-09-10T23:08:21.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 677113 14.54 MB/sec execute 137 sec latency 48.765 ms 2024-09-10T23:08:21.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 117847 2.42 MB/sec execute 140 sec latency 17.976 ms 2024-09-10T23:08:22.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 679051 14.53 MB/sec execute 138 sec latency 259.943 ms 2024-09-10T23:08:22.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:22 smithi046 ceph-mon[28128]: pgmap v438: 129 pgs: 129 active+clean; 73 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:08:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:22 smithi073 ceph-mon[35473]: pgmap v438: 129 pgs: 129 active+clean; 73 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:08:22.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 118300 2.42 MB/sec execute 141 sec latency 20.418 ms 2024-09-10T23:08:23.659 INFO:tasks.workunit.client.0.smithi046.stdout: 1 682546 14.56 MB/sec execute 139 sec latency 50.136 ms 2024-09-10T23:08:23.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 118785 2.42 MB/sec execute 142 sec latency 30.015 ms 2024-09-10T23:08:24.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 685193 14.56 MB/sec execute 140 sec latency 56.385 ms 2024-09-10T23:08:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:24 smithi046 ceph-mon[28128]: pgmap v439: 129 pgs: 129 active+clean; 73 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 51 op/s 2024-09-10T23:08:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:24 smithi073 ceph-mon[35473]: pgmap v439: 129 pgs: 129 active+clean; 73 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 51 op/s 2024-09-10T23:08:24.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 119277 2.41 MB/sec execute 143 sec latency 16.190 ms 2024-09-10T23:08:25.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 688397 14.58 MB/sec execute 141 sec latency 42.959 ms 2024-09-10T23:08:25.874 INFO:tasks.workunit.client.1.smithi073.stdout: 1 119698 2.41 MB/sec execute 144 sec latency 20.496 ms 2024-09-10T23:08:26.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 691404 14.57 MB/sec execute 142 sec latency 49.482 ms 2024-09-10T23:08:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:26 smithi046 ceph-mon[28128]: pgmap v440: 129 pgs: 129 active+clean; 72 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2024-09-10T23:08:26.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:26 smithi073 ceph-mon[35473]: pgmap v440: 129 pgs: 129 active+clean; 72 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2024-09-10T23:08:26.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 120381 2.44 MB/sec execute 145 sec latency 73.134 ms 2024-09-10T23:08:27.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 692144 14.51 MB/sec execute 143 sec latency 736.055 ms 2024-09-10T23:08:27.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 120595 2.44 MB/sec execute 146 sec latency 398.152 ms 2024-09-10T23:08:28.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 692144 14.41 MB/sec execute 144 sec latency 1161.257 ms 2024-09-10T23:08:28.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:28 smithi046 ceph-mon[28128]: pgmap v441: 129 pgs: 129 active+clean; 73 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:08:28.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:28 smithi073 ceph-mon[35473]: pgmap v441: 129 pgs: 129 active+clean; 73 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:08:28.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 120945 2.43 MB/sec execute 147 sec latency 116.850 ms 2024-09-10T23:08:29.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 692243 14.32 MB/sec execute 145 sec latency 1978.580 ms 2024-09-10T23:08:29.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 121068 2.42 MB/sec execute 148 sec latency 425.551 ms 2024-09-10T23:08:30.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 693304 14.26 MB/sec execute 146 sec latency 598.771 ms 2024-09-10T23:08:30.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:30 smithi046 ceph-mon[28128]: pgmap v442: 129 pgs: 129 active+clean; 73 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:08:30.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:30 smithi073 ceph-mon[35473]: pgmap v442: 129 pgs: 129 active+clean; 73 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:08:30.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 121457 2.41 MB/sec execute 149 sec latency 229.216 ms 2024-09-10T23:08:31.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 696841 14.29 MB/sec execute 147 sec latency 41.137 ms 2024-09-10T23:08:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:31.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:31.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 121918 2.40 MB/sec execute 150 sec latency 14.824 ms 2024-09-10T23:08:32.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 700268 14.32 MB/sec execute 148 sec latency 81.295 ms 2024-09-10T23:08:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:32 smithi046 ceph-mon[28128]: pgmap v443: 129 pgs: 129 active+clean; 75 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-09-10T23:08:32.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:32 smithi073 ceph-mon[35473]: pgmap v443: 129 pgs: 129 active+clean; 75 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-09-10T23:08:32.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 122450 2.41 MB/sec execute 151 sec latency 16.637 ms 2024-09-10T23:08:33.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 702877 14.32 MB/sec execute 149 sec latency 56.107 ms 2024-09-10T23:08:33.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 122963 2.40 MB/sec execute 152 sec latency 14.876 ms 2024-09-10T23:08:34.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 705548 14.30 MB/sec execute 150 sec latency 80.795 ms 2024-09-10T23:08:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:34 smithi046 ceph-mon[28128]: pgmap v444: 129 pgs: 129 active+clean; 75 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 917 KiB/s wr, 50 op/s 2024-09-10T23:08:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:34 smithi073 ceph-mon[35473]: pgmap v444: 129 pgs: 129 active+clean; 75 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 917 KiB/s wr, 50 op/s 2024-09-10T23:08:34.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 123510 2.41 MB/sec execute 153 sec latency 16.453 ms 2024-09-10T23:08:35.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 707352 14.29 MB/sec execute 151 sec latency 399.241 ms 2024-09-10T23:08:35.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 123952 2.42 MB/sec execute 154 sec latency 19.707 ms 2024-09-10T23:08:36.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 709670 14.28 MB/sec execute 152 sec latency 383.535 ms 2024-09-10T23:08:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:36 smithi046 ceph-mon[28128]: pgmap v445: 129 pgs: 129 active+clean; 75 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 975 KiB/s wr, 70 op/s 2024-09-10T23:08:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:36 smithi073 ceph-mon[35473]: pgmap v445: 129 pgs: 129 active+clean; 75 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 975 KiB/s wr, 70 op/s 2024-09-10T23:08:36.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 124422 2.43 MB/sec execute 155 sec latency 14.645 ms 2024-09-10T23:08:37.660 INFO:tasks.workunit.client.0.smithi046.stdout: 1 712714 14.28 MB/sec execute 153 sec latency 49.972 ms 2024-09-10T23:08:37.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 124703 2.42 MB/sec execute 156 sec latency 14.946 ms 2024-09-10T23:08:38.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 715659 14.29 MB/sec execute 154 sec latency 58.255 ms 2024-09-10T23:08:38.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:38 smithi046 ceph-mon[28128]: pgmap v446: 129 pgs: 129 active+clean; 75 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:08:38.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:38 smithi073 ceph-mon[35473]: pgmap v446: 129 pgs: 129 active+clean; 75 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:08:38.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 125139 2.41 MB/sec execute 157 sec latency 22.731 ms 2024-09-10T23:08:39.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 718303 14.30 MB/sec execute 155 sec latency 73.618 ms 2024-09-10T23:08:39.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 125666 2.42 MB/sec execute 158 sec latency 15.674 ms 2024-09-10T23:08:40.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 721662 14.32 MB/sec execute 156 sec latency 104.640 ms 2024-09-10T23:08:40.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:40 smithi046 ceph-mon[28128]: pgmap v447: 129 pgs: 129 active+clean; 75 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 934 KiB/s wr, 51 op/s 2024-09-10T23:08:40.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:40 smithi073 ceph-mon[35473]: pgmap v447: 129 pgs: 129 active+clean; 75 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 934 KiB/s wr, 51 op/s 2024-09-10T23:08:40.875 INFO:tasks.workunit.client.1.smithi073.stdout: 1 126163 2.41 MB/sec execute 159 sec latency 17.170 ms 2024-09-10T23:08:41.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 721849 14.23 MB/sec execute 157 sec latency 749.646 ms 2024-09-10T23:08:41.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 126571 2.40 MB/sec execute 160 sec latency 148.789 ms 2024-09-10T23:08:42.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 725288 14.26 MB/sec execute 158 sec latency 48.980 ms 2024-09-10T23:08:42.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:42 smithi046 ceph-mon[28128]: pgmap v448: 129 pgs: 129 active+clean; 76 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 74 op/s 2024-09-10T23:08:42.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:42 smithi073 ceph-mon[35473]: pgmap v448: 129 pgs: 129 active+clean; 76 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 74 op/s 2024-09-10T23:08:42.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 127121 2.42 MB/sec execute 161 sec latency 22.247 ms 2024-09-10T23:08:43.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 728747 14.29 MB/sec execute 159 sec latency 50.200 ms 2024-09-10T23:08:43.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 127516 2.42 MB/sec execute 162 sec latency 19.134 ms 2024-09-10T23:08:44.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 732179 14.32 MB/sec execute 160 sec latency 76.311 ms 2024-09-10T23:08:44.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:44 smithi046 ceph-mon[28128]: pgmap v449: 129 pgs: 129 active+clean; 75 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1011 KiB/s wr, 57 op/s 2024-09-10T23:08:44.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:44 smithi073 ceph-mon[35473]: pgmap v449: 129 pgs: 129 active+clean; 75 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1011 KiB/s wr, 57 op/s 2024-09-10T23:08:44.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 128008 2.43 MB/sec execute 163 sec latency 16.685 ms 2024-09-10T23:08:45.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 734414 14.31 MB/sec execute 161 sec latency 118.395 ms 2024-09-10T23:08:45.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 128285 2.42 MB/sec execute 164 sec latency 16.877 ms 2024-09-10T23:08:46.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 735838 14.26 MB/sec execute 162 sec latency 445.993 ms 2024-09-10T23:08:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:46 smithi046 ceph-mon[28128]: pgmap v450: 129 pgs: 129 active+clean; 76 MiB data, 687 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 76 op/s 2024-09-10T23:08:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:46 smithi073 ceph-mon[35473]: pgmap v450: 129 pgs: 129 active+clean; 76 MiB data, 687 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 76 op/s 2024-09-10T23:08:46.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:08:46.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 128611 2.41 MB/sec execute 165 sec latency 286.542 ms 2024-09-10T23:08:47.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 738232 14.26 MB/sec execute 163 sec latency 782.642 ms 2024-09-10T23:08:47.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 129111 2.42 MB/sec execute 166 sec latency 19.261 ms 2024-09-10T23:08:48.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 740932 14.25 MB/sec execute 164 sec latency 58.091 ms 2024-09-10T23:08:48.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:48 smithi046 ceph-mon[28128]: pgmap v451: 129 pgs: 129 active+clean; 77 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-10T23:08:48.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:48 smithi073 ceph-mon[35473]: pgmap v451: 129 pgs: 129 active+clean; 77 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-10T23:08:48.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 129559 2.41 MB/sec execute 167 sec latency 18.574 ms 2024-09-10T23:08:49.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 743766 14.27 MB/sec execute 165 sec latency 49.958 ms 2024-09-10T23:08:49.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 130062 2.40 MB/sec execute 168 sec latency 18.657 ms 2024-09-10T23:08:50.661 INFO:tasks.workunit.client.0.smithi046.stdout: 1 746489 14.27 MB/sec execute 166 sec latency 84.610 ms 2024-09-10T23:08:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:50 smithi046 ceph-mon[28128]: pgmap v452: 129 pgs: 129 active+clean; 77 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 54 op/s 2024-09-10T23:08:50.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:50 smithi073 ceph-mon[35473]: pgmap v452: 129 pgs: 129 active+clean; 77 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 54 op/s 2024-09-10T23:08:50.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 130622 2.42 MB/sec execute 169 sec latency 16.493 ms 2024-09-10T23:08:51.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 749964 14.29 MB/sec execute 167 sec latency 58.379 ms 2024-09-10T23:08:51.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 131053 2.42 MB/sec execute 170 sec latency 18.569 ms 2024-09-10T23:08:52.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 753500 14.32 MB/sec execute 168 sec latency 50.212 ms 2024-09-10T23:08:52.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:52 smithi046 ceph-mon[28128]: pgmap v453: 129 pgs: 129 active+clean; 76 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:08:52.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:52 smithi073 ceph-mon[35473]: pgmap v453: 129 pgs: 129 active+clean; 76 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:08:52.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 131533 2.43 MB/sec execute 171 sec latency 14.994 ms 2024-09-10T23:08:53.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 756994 14.35 MB/sec execute 169 sec latency 42.468 ms 2024-09-10T23:08:53.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 131816 2.42 MB/sec execute 172 sec latency 15.170 ms 2024-09-10T23:08:54.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 759613 14.35 MB/sec execute 170 sec latency 46.813 ms 2024-09-10T23:08:54.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:54 smithi046 ceph-mon[28128]: pgmap v454: 129 pgs: 129 active+clean; 76 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 927 KiB/s wr, 53 op/s 2024-09-10T23:08:54.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:54 smithi073 ceph-mon[35473]: pgmap v454: 129 pgs: 129 active+clean; 76 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 927 KiB/s wr, 53 op/s 2024-09-10T23:08:54.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 132256 2.41 MB/sec execute 173 sec latency 18.568 ms 2024-09-10T23:08:55.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 762785 14.37 MB/sec execute 171 sec latency 48.651 ms 2024-09-10T23:08:55.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:55 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:08:55.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:55 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:08:55.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 132749 2.42 MB/sec execute 174 sec latency 17.858 ms 2024-09-10T23:08:56.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 765827 14.36 MB/sec execute 172 sec latency 52.801 ms 2024-09-10T23:08:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:56 smithi046 ceph-mon[28128]: pgmap v455: 129 pgs: 129 active+clean; 79 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:08:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:56 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:08:56.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:56 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:08:56.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:56 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:08:56.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:56 smithi073 ceph-mon[35473]: pgmap v455: 129 pgs: 129 active+clean; 79 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:08:56.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:56 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:08:56.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:56 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:08:56.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:56 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:08:56.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 133213 2.41 MB/sec execute 175 sec latency 17.907 ms 2024-09-10T23:08:57.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 768847 14.38 MB/sec execute 173 sec latency 50.133 ms 2024-09-10T23:08:57.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 133689 2.40 MB/sec execute 176 sec latency 19.561 ms 2024-09-10T23:08:58.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 771489 14.38 MB/sec execute 174 sec latency 54.632 ms 2024-09-10T23:08:58.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:08:58 smithi046 ceph-mon[28128]: pgmap v456: 129 pgs: 129 active+clean; 79 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 59 op/s 2024-09-10T23:08:58.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:08:58 smithi073 ceph-mon[35473]: pgmap v456: 129 pgs: 129 active+clean; 79 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 59 op/s 2024-09-10T23:08:58.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 134297 2.42 MB/sec execute 177 sec latency 17.171 ms 2024-09-10T23:08:59.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 774858 14.41 MB/sec execute 175 sec latency 57.109 ms 2024-09-10T23:08:59.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 134667 2.42 MB/sec execute 178 sec latency 19.604 ms 2024-09-10T23:09:00.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 778330 14.43 MB/sec execute 176 sec latency 51.923 ms 2024-09-10T23:09:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:00 smithi046 ceph-mon[28128]: pgmap v457: 129 pgs: 129 active+clean; 79 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:09:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:00 smithi073 ceph-mon[35473]: pgmap v457: 129 pgs: 129 active+clean; 79 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:09:00.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 135145 2.43 MB/sec execute 179 sec latency 19.016 ms 2024-09-10T23:09:01.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 781820 14.46 MB/sec execute 177 sec latency 45.750 ms 2024-09-10T23:09:01.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:01.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 135442 2.41 MB/sec execute 180 sec latency 15.350 ms 2024-09-10T23:09:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:02.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 784474 14.46 MB/sec execute 178 sec latency 46.894 ms 2024-09-10T23:09:02.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:02 smithi073 ceph-mon[35473]: pgmap v458: 129 pgs: 129 active+clean; 80 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:09:02.876 INFO:tasks.workunit.client.1.smithi073.stdout: 1 135929 2.41 MB/sec execute 181 sec latency 19.869 ms 2024-09-10T23:09:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:02 smithi046 ceph-mon[28128]: pgmap v458: 129 pgs: 129 active+clean; 80 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:09:03.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 787448 14.46 MB/sec execute 179 sec latency 58.451 ms 2024-09-10T23:09:03.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 136402 2.42 MB/sec execute 182 sec latency 26.358 ms 2024-09-10T23:09:04.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 790123 14.46 MB/sec execute 180 sec latency 54.496 ms 2024-09-10T23:09:04.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:04 smithi073 ceph-mon[35473]: pgmap v459: 129 pgs: 129 active+clean; 80 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:09:04.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 136887 2.41 MB/sec execute 183 sec latency 17.932 ms 2024-09-10T23:09:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:04 smithi046 ceph-mon[28128]: pgmap v459: 129 pgs: 129 active+clean; 80 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:09:05.662 INFO:tasks.workunit.client.0.smithi046.stdout: 1 792762 14.46 MB/sec execute 181 sec latency 107.020 ms 2024-09-10T23:09:05.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 137316 2.40 MB/sec execute 184 sec latency 20.311 ms 2024-09-10T23:09:06.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 796128 14.48 MB/sec execute 182 sec latency 65.289 ms 2024-09-10T23:09:06.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 138085 2.43 MB/sec execute 185 sec latency 19.744 ms 2024-09-10T23:09:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:06 smithi046 ceph-mon[28128]: pgmap v460: 129 pgs: 129 active+clean; 80 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:09:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:06 smithi073 ceph-mon[35473]: pgmap v460: 129 pgs: 129 active+clean; 80 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:09:07.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 799600 14.51 MB/sec execute 183 sec latency 49.928 ms 2024-09-10T23:09:07.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 138386 2.43 MB/sec execute 186 sec latency 19.027 ms 2024-09-10T23:09:08.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 803097 14.53 MB/sec execute 184 sec latency 45.237 ms 2024-09-10T23:09:08.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 138693 2.42 MB/sec execute 187 sec latency 216.703 ms 2024-09-10T23:09:08.881 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:08 smithi073 ceph-mon[35473]: pgmap v461: 129 pgs: 129 active+clean; 79 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:09:08.961 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:08 smithi046 ceph-mon[28128]: pgmap v461: 129 pgs: 129 active+clean; 79 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:09:09.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 805983 14.55 MB/sec execute 185 sec latency 49.508 ms 2024-09-10T23:09:09.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 138921 2.41 MB/sec execute 188 sec latency 404.621 ms 2024-09-10T23:09:10.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 808720 14.54 MB/sec execute 186 sec latency 83.640 ms 2024-09-10T23:09:10.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 139346 2.41 MB/sec execute 189 sec latency 22.113 ms 2024-09-10T23:09:10.941 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:10 smithi073 ceph-mon[35473]: pgmap v462: 129 pgs: 129 active+clean; 79 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 930 KiB/s wr, 56 op/s 2024-09-10T23:09:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:10 smithi046 ceph-mon[28128]: pgmap v462: 129 pgs: 129 active+clean; 79 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 930 KiB/s wr, 56 op/s 2024-09-10T23:09:11.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 811396 14.53 MB/sec execute 187 sec latency 50.201 ms 2024-09-10T23:09:11.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 139842 2.41 MB/sec execute 190 sec latency 18.198 ms 2024-09-10T23:09:12.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 813789 14.53 MB/sec execute 188 sec latency 342.887 ms 2024-09-10T23:09:12.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 140231 2.40 MB/sec execute 191 sec latency 198.656 ms 2024-09-10T23:09:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:12 smithi046 ceph-mon[28128]: pgmap v463: 129 pgs: 129 active+clean; 82 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2024-09-10T23:09:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:12 smithi073 ceph-mon[35473]: pgmap v463: 129 pgs: 129 active+clean; 82 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2024-09-10T23:09:13.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 817270 14.55 MB/sec execute 189 sec latency 433.582 ms 2024-09-10T23:09:13.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 140730 2.40 MB/sec execute 192 sec latency 18.887 ms 2024-09-10T23:09:14.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 819590 14.54 MB/sec execute 190 sec latency 56.911 ms 2024-09-10T23:09:14.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 141303 2.42 MB/sec execute 193 sec latency 17.234 ms 2024-09-10T23:09:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:14 smithi046 ceph-mon[28128]: pgmap v464: 129 pgs: 129 active+clean; 82 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 975 KiB/s wr, 52 op/s 2024-09-10T23:09:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:14 smithi073 ceph-mon[35473]: pgmap v464: 129 pgs: 129 active+clean; 82 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 975 KiB/s wr, 52 op/s 2024-09-10T23:09:15.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 822025 14.53 MB/sec execute 191 sec latency 122.700 ms 2024-09-10T23:09:15.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 141699 2.41 MB/sec execute 194 sec latency 16.691 ms 2024-09-10T23:09:16.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 824673 14.53 MB/sec execute 192 sec latency 65.648 ms 2024-09-10T23:09:16.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 142191 2.42 MB/sec execute 195 sec latency 15.521 ms 2024-09-10T23:09:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:16 smithi046 ceph-mon[28128]: pgmap v465: 129 pgs: 129 active+clean; 82 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 72 op/s 2024-09-10T23:09:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:16 smithi073 ceph-mon[35473]: pgmap v465: 129 pgs: 129 active+clean; 82 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 72 op/s 2024-09-10T23:09:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:17.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 828030 14.55 MB/sec execute 193 sec latency 52.520 ms 2024-09-10T23:09:17.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 142473 2.41 MB/sec execute 196 sec latency 17.334 ms 2024-09-10T23:09:18.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 828867 14.50 MB/sec execute 194 sec latency 671.515 ms 2024-09-10T23:09:18.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 142766 2.40 MB/sec execute 197 sec latency 389.469 ms 2024-09-10T23:09:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:18 smithi046 ceph-mon[28128]: pgmap v466: 129 pgs: 129 active+clean; 82 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.2 MiB/s wr, 57 op/s 2024-09-10T23:09:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:18 smithi073 ceph-mon[35473]: pgmap v466: 129 pgs: 129 active+clean; 82 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.2 MiB/s wr, 57 op/s 2024-09-10T23:09:19.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 828867 14.42 MB/sec execute 195 sec latency 1031.200 ms 2024-09-10T23:09:19.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 143093 2.40 MB/sec execute 198 sec latency 247.884 ms 2024-09-10T23:09:20.663 INFO:tasks.workunit.client.0.smithi046.stdout: 1 829118 14.35 MB/sec execute 196 sec latency 1333.513 ms 2024-09-10T23:09:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:20 smithi046 ceph-mon[28128]: pgmap v467: 129 pgs: 129 active+clean; 82 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-10T23:09:20.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 143408 2.40 MB/sec execute 199 sec latency 365.190 ms 2024-09-10T23:09:20.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:20 smithi073 ceph-mon[35473]: pgmap v467: 129 pgs: 129 active+clean; 82 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-10T23:09:21.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 829122 14.28 MB/sec execute 197 sec latency 767.612 ms 2024-09-10T23:09:21.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 143687 2.39 MB/sec execute 200 sec latency 406.352 ms 2024-09-10T23:09:22.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 831585 14.28 MB/sec execute 198 sec latency 449.881 ms 2024-09-10T23:09:22.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 144137 2.38 MB/sec execute 201 sec latency 19.138 ms 2024-09-10T23:09:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:22 smithi046 ceph-mon[28128]: pgmap v468: 129 pgs: 129 active+clean; 83 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.3 MiB/s wr, 72 op/s 2024-09-10T23:09:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:22 smithi073 ceph-mon[35473]: pgmap v468: 129 pgs: 129 active+clean; 83 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.3 MiB/s wr, 72 op/s 2024-09-10T23:09:23.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 835124 14.30 MB/sec execute 199 sec latency 45.245 ms 2024-09-10T23:09:23.877 INFO:tasks.workunit.client.1.smithi073.stdout: 1 144662 2.40 MB/sec execute 202 sec latency 15.522 ms 2024-09-10T23:09:24.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 838709 14.33 MB/sec execute 200 sec latency 41.821 ms 2024-09-10T23:09:24.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 145221 2.40 MB/sec execute 203 sec latency 19.446 ms 2024-09-10T23:09:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:24 smithi046 ceph-mon[28128]: pgmap v469: 129 pgs: 129 active+clean; 83 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 970 KiB/s wr, 55 op/s 2024-09-10T23:09:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:24 smithi073 ceph-mon[35473]: pgmap v469: 129 pgs: 129 active+clean; 83 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 970 KiB/s wr, 55 op/s 2024-09-10T23:09:25.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 842186 14.35 MB/sec execute 201 sec latency 67.920 ms 2024-09-10T23:09:25.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 145669 2.41 MB/sec execute 204 sec latency 17.882 ms 2024-09-10T23:09:26.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 845704 14.37 MB/sec execute 202 sec latency 54.513 ms 2024-09-10T23:09:26.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 145937 2.40 MB/sec execute 205 sec latency 14.166 ms 2024-09-10T23:09:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:26 smithi046 ceph-mon[28128]: pgmap v470: 129 pgs: 129 active+clean; 83 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-10T23:09:27.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:26 smithi073 ceph-mon[35473]: pgmap v470: 129 pgs: 129 active+clean; 83 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-10T23:09:27.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 845830 14.30 MB/sec execute 203 sec latency 571.503 ms 2024-09-10T23:09:27.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 146374 2.39 MB/sec execute 206 sec latency 18.297 ms 2024-09-10T23:09:28.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 849308 14.33 MB/sec execute 204 sec latency 57.244 ms 2024-09-10T23:09:28.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 146863 2.40 MB/sec execute 207 sec latency 26.410 ms 2024-09-10T23:09:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:28 smithi046 ceph-mon[28128]: pgmap v471: 129 pgs: 129 active+clean; 84 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 55 op/s 2024-09-10T23:09:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:28 smithi073 ceph-mon[35473]: pgmap v471: 129 pgs: 129 active+clean; 84 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 55 op/s 2024-09-10T23:09:29.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 852794 14.35 MB/sec execute 205 sec latency 65.698 ms 2024-09-10T23:09:29.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 147335 2.39 MB/sec execute 208 sec latency 20.506 ms 2024-09-10T23:09:30.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 855920 14.37 MB/sec execute 206 sec latency 45.256 ms 2024-09-10T23:09:30.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 147830 2.39 MB/sec execute 209 sec latency 17.806 ms 2024-09-10T23:09:30.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:30 smithi073 ceph-mon[35473]: pgmap v472: 129 pgs: 129 active+clean; 85 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 967 KiB/s wr, 50 op/s 2024-09-10T23:09:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:30 smithi046 ceph-mon[28128]: pgmap v472: 129 pgs: 129 active+clean; 85 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 967 KiB/s wr, 50 op/s 2024-09-10T23:09:31.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 858651 14.36 MB/sec execute 207 sec latency 66.528 ms 2024-09-10T23:09:31.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 148423 2.40 MB/sec execute 210 sec latency 19.029 ms 2024-09-10T23:09:32.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:32.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:32.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 860126 14.33 MB/sec execute 208 sec latency 375.335 ms 2024-09-10T23:09:32.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 148808 2.40 MB/sec execute 211 sec latency 16.194 ms 2024-09-10T23:09:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:32 smithi046 ceph-mon[28128]: pgmap v473: 129 pgs: 129 active+clean; 86 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:09:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:32 smithi073 ceph-mon[35473]: pgmap v473: 129 pgs: 129 active+clean; 86 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:09:33.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 862538 14.33 MB/sec execute 209 sec latency 440.920 ms 2024-09-10T23:09:33.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 149297 2.41 MB/sec execute 212 sec latency 16.348 ms 2024-09-10T23:09:34.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 866047 14.35 MB/sec execute 210 sec latency 111.474 ms 2024-09-10T23:09:34.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 149589 2.40 MB/sec execute 213 sec latency 18.236 ms 2024-09-10T23:09:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:34 smithi046 ceph-mon[28128]: pgmap v474: 129 pgs: 129 active+clean; 85 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 874 KiB/s wr, 51 op/s 2024-09-10T23:09:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:34 smithi073 ceph-mon[35473]: pgmap v474: 129 pgs: 129 active+clean; 85 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 874 KiB/s wr, 51 op/s 2024-09-10T23:09:35.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 869594 14.37 MB/sec execute 211 sec latency 50.042 ms 2024-09-10T23:09:35.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 150056 2.40 MB/sec execute 214 sec latency 18.247 ms 2024-09-10T23:09:36.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 873031 14.39 MB/sec execute 212 sec latency 49.515 ms 2024-09-10T23:09:36.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 150545 2.40 MB/sec execute 215 sec latency 18.883 ms 2024-09-10T23:09:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:36 smithi046 ceph-mon[28128]: pgmap v475: 129 pgs: 129 active+clean; 86 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:09:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:36 smithi073 ceph-mon[35473]: pgmap v475: 129 pgs: 129 active+clean; 86 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:09:37.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 876304 14.41 MB/sec execute 213 sec latency 50.154 ms 2024-09-10T23:09:37.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 151054 2.39 MB/sec execute 216 sec latency 17.486 ms 2024-09-10T23:09:38.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 877613 14.37 MB/sec execute 214 sec latency 454.573 ms 2024-09-10T23:09:38.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 151433 2.39 MB/sec execute 217 sec latency 173.350 ms 2024-09-10T23:09:38.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:38 smithi073 ceph-mon[35473]: pgmap v476: 129 pgs: 129 active+clean; 87 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:09:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:38 smithi046 ceph-mon[28128]: pgmap v476: 129 pgs: 129 active+clean; 87 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:09:39.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 880121 14.37 MB/sec execute 215 sec latency 569.792 ms 2024-09-10T23:09:39.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 152030 2.40 MB/sec execute 218 sec latency 16.851 ms 2024-09-10T23:09:40.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 882955 14.36 MB/sec execute 216 sec latency 55.705 ms 2024-09-10T23:09:40.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 152503 2.41 MB/sec execute 219 sec latency 18.010 ms 2024-09-10T23:09:40.943 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:40 smithi073 ceph-mon[35473]: pgmap v477: 129 pgs: 129 active+clean; 86 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 962 KiB/s wr, 55 op/s 2024-09-10T23:09:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:40 smithi046 ceph-mon[28128]: pgmap v477: 129 pgs: 129 active+clean; 86 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 962 KiB/s wr, 55 op/s 2024-09-10T23:09:41.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 885657 14.37 MB/sec execute 217 sec latency 60.904 ms 2024-09-10T23:09:41.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 152891 2.41 MB/sec execute 220 sec latency 17.692 ms 2024-09-10T23:09:42.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 888559 14.37 MB/sec execute 218 sec latency 50.140 ms 2024-09-10T23:09:42.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 153207 2.40 MB/sec execute 221 sec latency 22.064 ms 2024-09-10T23:09:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:42 smithi046 ceph-mon[28128]: pgmap v478: 129 pgs: 129 active+clean; 87 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 79 op/s 2024-09-10T23:09:43.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:42 smithi073 ceph-mon[35473]: pgmap v478: 129 pgs: 129 active+clean; 87 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 79 op/s 2024-09-10T23:09:43.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 891917 14.39 MB/sec execute 219 sec latency 116.667 ms 2024-09-10T23:09:43.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 153659 2.40 MB/sec execute 222 sec latency 41.239 ms 2024-09-10T23:09:44.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 892748 14.35 MB/sec execute 220 sec latency 693.858 ms 2024-09-10T23:09:44.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 154138 2.40 MB/sec execute 223 sec latency 18.124 ms 2024-09-10T23:09:44.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:44 smithi046 ceph-mon[28128]: pgmap v479: 129 pgs: 129 active+clean; 87 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:09:45.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:44 smithi073 ceph-mon[35473]: pgmap v479: 129 pgs: 129 active+clean; 87 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:09:45.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 895466 14.35 MB/sec execute 221 sec latency 72.265 ms 2024-09-10T23:09:45.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 154632 2.39 MB/sec execute 224 sec latency 19.050 ms 2024-09-10T23:09:46.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 898883 14.37 MB/sec execute 222 sec latency 112.293 ms 2024-09-10T23:09:46.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 155098 2.39 MB/sec execute 225 sec latency 17.447 ms 2024-09-10T23:09:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:46 smithi046 ceph-mon[28128]: pgmap v480: 129 pgs: 129 active+clean; 87 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-10T23:09:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:46 smithi073 ceph-mon[35473]: pgmap v480: 129 pgs: 129 active+clean; 87 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-10T23:09:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:09:47.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 901394 14.36 MB/sec execute 223 sec latency 83.460 ms 2024-09-10T23:09:47.878 INFO:tasks.workunit.client.1.smithi073.stdout: 1 155827 2.41 MB/sec execute 226 sec latency 17.265 ms 2024-09-10T23:09:48.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 904126 14.36 MB/sec execute 224 sec latency 55.135 ms 2024-09-10T23:09:48.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 156164 2.41 MB/sec execute 227 sec latency 18.944 ms 2024-09-10T23:09:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:48 smithi046 ceph-mon[28128]: pgmap v481: 129 pgs: 129 active+clean; 88 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 63 op/s 2024-09-10T23:09:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:48 smithi073 ceph-mon[35473]: pgmap v481: 129 pgs: 129 active+clean; 88 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 63 op/s 2024-09-10T23:09:49.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 906848 14.37 MB/sec execute 225 sec latency 58.548 ms 2024-09-10T23:09:49.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 156502 2.41 MB/sec execute 228 sec latency 16.214 ms 2024-09-10T23:09:50.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 909648 14.37 MB/sec execute 226 sec latency 49.910 ms 2024-09-10T23:09:50.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 156866 2.40 MB/sec execute 229 sec latency 23.229 ms 2024-09-10T23:09:50.943 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:50 smithi073 ceph-mon[35473]: pgmap v482: 129 pgs: 129 active+clean; 87 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1000 KiB/s wr, 60 op/s 2024-09-10T23:09:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:50 smithi046 ceph-mon[28128]: pgmap v482: 129 pgs: 129 active+clean; 87 MiB data, 748 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1000 KiB/s wr, 60 op/s 2024-09-10T23:09:51.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 913123 14.39 MB/sec execute 227 sec latency 56.172 ms 2024-09-10T23:09:51.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 157315 2.40 MB/sec execute 230 sec latency 16.558 ms 2024-09-10T23:09:52.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 916618 14.41 MB/sec execute 228 sec latency 66.761 ms 2024-09-10T23:09:52.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 157806 2.40 MB/sec execute 231 sec latency 16.836 ms 2024-09-10T23:09:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:52 smithi046 ceph-mon[28128]: pgmap v483: 129 pgs: 129 active+clean; 90 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-10T23:09:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:52 smithi073 ceph-mon[35473]: pgmap v483: 129 pgs: 129 active+clean; 90 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-10T23:09:53.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 919104 14.47 MB/sec execute 229 sec latency 58.306 ms 2024-09-10T23:09:53.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 158317 2.39 MB/sec execute 232 sec latency 18.399 ms 2024-09-10T23:09:54.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 921735 14.48 MB/sec execute 230 sec latency 41.704 ms 2024-09-10T23:09:54.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 158811 2.40 MB/sec execute 233 sec latency 18.576 ms 2024-09-10T23:09:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:54 smithi046 ceph-mon[28128]: pgmap v484: 129 pgs: 129 active+clean; 90 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:09:55.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:54 smithi073 ceph-mon[35473]: pgmap v484: 129 pgs: 129 active+clean; 90 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:09:55.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 924602 14.48 MB/sec execute 231 sec latency 48.219 ms 2024-09-10T23:09:55.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 159404 2.41 MB/sec execute 234 sec latency 16.564 ms 2024-09-10T23:09:56.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 928071 14.50 MB/sec execute 232 sec latency 54.488 ms 2024-09-10T23:09:56.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 159860 2.42 MB/sec execute 235 sec latency 19.121 ms 2024-09-10T23:09:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:56 smithi046 ceph-mon[28128]: pgmap v485: 129 pgs: 129 active+clean; 88 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:09:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:56 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:09:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:56 smithi073 ceph-mon[35473]: pgmap v485: 129 pgs: 129 active+clean; 88 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:09:57.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:56 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:09:57.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 931223 14.52 MB/sec execute 233 sec latency 49.298 ms 2024-09-10T23:09:57.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 160128 2.41 MB/sec execute 236 sec latency 14.208 ms 2024-09-10T23:09:58.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:09:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:09:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:09:58.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:57 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:09:58.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:57 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:09:58.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 933649 14.51 MB/sec execute 234 sec latency 58.441 ms 2024-09-10T23:09:58.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 160563 2.40 MB/sec execute 237 sec latency 19.591 ms 2024-09-10T23:09:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:58 smithi046 ceph-mon[28128]: pgmap v486: 129 pgs: 129 active+clean; 90 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:09:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:09:58 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi046 to 913.5M 2024-09-10T23:09:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:58 smithi073 ceph-mon[35473]: pgmap v486: 129 pgs: 129 active+clean; 90 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:09:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:09:58 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi046 to 913.5M 2024-09-10T23:09:59.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 936323 14.50 MB/sec execute 235 sec latency 47.475 ms 2024-09-10T23:09:59.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 161040 2.41 MB/sec execute 238 sec latency 19.516 ms 2024-09-10T23:10:00.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 938825 14.50 MB/sec execute 236 sec latency 68.847 ms 2024-09-10T23:10:00.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 161503 2.40 MB/sec execute 239 sec latency 22.199 ms 2024-09-10T23:10:00.944 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:00 smithi073 ceph-mon[35473]: pgmap v487: 129 pgs: 129 active+clean; 90 MiB data, 761 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:10:00.944 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:00 smithi073 ceph-mon[35473]: overall HEALTH_OK 2024-09-10T23:10:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:00 smithi046 ceph-mon[28128]: pgmap v487: 129 pgs: 129 active+clean; 90 MiB data, 761 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-09-10T23:10:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:00 smithi046 ceph-mon[28128]: overall HEALTH_OK 2024-09-10T23:10:01.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 942297 14.52 MB/sec execute 237 sec latency 74.780 ms 2024-09-10T23:10:01.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 162003 2.40 MB/sec execute 240 sec latency 17.778 ms 2024-09-10T23:10:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:02.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:02.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 944887 14.52 MB/sec execute 238 sec latency 58.436 ms 2024-09-10T23:10:02.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 162573 2.41 MB/sec execute 241 sec latency 15.749 ms 2024-09-10T23:10:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:02 smithi046 ceph-mon[28128]: pgmap v488: 129 pgs: 129 active+clean; 92 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:10:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:02 smithi073 ceph-mon[35473]: pgmap v488: 129 pgs: 129 active+clean; 92 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:10:03.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 948024 14.53 MB/sec execute 239 sec latency 44.713 ms 2024-09-10T23:10:03.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 162975 2.41 MB/sec execute 242 sec latency 16.873 ms 2024-09-10T23:10:04.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 949579 14.50 MB/sec execute 240 sec latency 120.332 ms 2024-09-10T23:10:04.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 163387 2.42 MB/sec execute 243 sec latency 287.849 ms 2024-09-10T23:10:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:04 smithi046 ceph-mon[28128]: pgmap v489: 129 pgs: 129 active+clean; 92 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 998 KiB/s wr, 57 op/s 2024-09-10T23:10:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:04 smithi073 ceph-mon[35473]: pgmap v489: 129 pgs: 129 active+clean; 92 MiB data, 783 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 998 KiB/s wr, 57 op/s 2024-09-10T23:10:05.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 952430 14.51 MB/sec execute 241 sec latency 450.213 ms 2024-09-10T23:10:05.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 163643 2.41 MB/sec execute 244 sec latency 338.795 ms 2024-09-10T23:10:06.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 954542 14.48 MB/sec execute 242 sec latency 149.949 ms 2024-09-10T23:10:06.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 163964 2.40 MB/sec execute 245 sec latency 184.010 ms 2024-09-10T23:10:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:06 smithi046 ceph-mon[28128]: pgmap v490: 129 pgs: 129 active+clean; 93 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:10:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:06 smithi073 ceph-mon[35473]: pgmap v490: 129 pgs: 129 active+clean; 93 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:10:07.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 956670 14.48 MB/sec execute 243 sec latency 44.514 ms 2024-09-10T23:10:07.879 INFO:tasks.workunit.client.1.smithi073.stdout: 1 164405 2.40 MB/sec execute 246 sec latency 18.547 ms 2024-09-10T23:10:08.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 960086 14.49 MB/sec execute 244 sec latency 41.830 ms 2024-09-10T23:10:08.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 164896 2.40 MB/sec execute 247 sec latency 20.759 ms 2024-09-10T23:10:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:08 smithi046 ceph-mon[28128]: pgmap v491: 129 pgs: 129 active+clean; 92 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-09-10T23:10:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:08 smithi073 ceph-mon[35473]: pgmap v491: 129 pgs: 129 active+clean; 92 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-09-10T23:10:09.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 963524 14.51 MB/sec execute 245 sec latency 46.960 ms 2024-09-10T23:10:09.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 165370 2.39 MB/sec execute 248 sec latency 19.407 ms 2024-09-10T23:10:10.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 964475 14.47 MB/sec execute 246 sec latency 246.326 ms 2024-09-10T23:10:10.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 165799 2.39 MB/sec execute 249 sec latency 17.351 ms 2024-09-10T23:10:10.944 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:10 smithi073 ceph-mon[35473]: pgmap v492: 129 pgs: 129 active+clean; 92 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-10T23:10:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:10 smithi046 ceph-mon[28128]: pgmap v492: 129 pgs: 129 active+clean; 92 MiB data, 786 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-10T23:10:11.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 967300 14.47 MB/sec execute 247 sec latency 45.846 ms 2024-09-10T23:10:11.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 166487 2.41 MB/sec execute 250 sec latency 15.580 ms 2024-09-10T23:10:12.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 970730 14.49 MB/sec execute 248 sec latency 40.078 ms 2024-09-10T23:10:12.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 166876 2.41 MB/sec execute 251 sec latency 18.798 ms 2024-09-10T23:10:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:12 smithi046 ceph-mon[28128]: pgmap v493: 129 pgs: 129 active+clean; 91 MiB data, 792 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:10:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:12 smithi073 ceph-mon[35473]: pgmap v493: 129 pgs: 129 active+clean; 91 MiB data, 792 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:10:13.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 974203 14.51 MB/sec execute 249 sec latency 49.633 ms 2024-09-10T23:10:13.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 167187 2.41 MB/sec execute 252 sec latency 18.776 ms 2024-09-10T23:10:14.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 976803 14.51 MB/sec execute 250 sec latency 48.895 ms 2024-09-10T23:10:14.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 167599 2.40 MB/sec execute 253 sec latency 18.053 ms 2024-09-10T23:10:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:14 smithi046 ceph-mon[28128]: pgmap v494: 129 pgs: 129 active+clean; 91 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 943 KiB/s wr, 51 op/s 2024-09-10T23:10:15.350 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:14 smithi073 ceph-mon[35473]: pgmap v494: 129 pgs: 129 active+clean; 91 MiB data, 793 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 943 KiB/s wr, 51 op/s 2024-09-10T23:10:15.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 977702 14.47 MB/sec execute 251 sec latency 758.001 ms 2024-09-10T23:10:15.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 168116 2.41 MB/sec execute 254 sec latency 16.846 ms 2024-09-10T23:10:16.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 977702 14.41 MB/sec execute 252 sec latency 1758.065 ms 2024-09-10T23:10:16.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 168577 2.40 MB/sec execute 255 sec latency 16.982 ms 2024-09-10T23:10:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:16 smithi046 ceph-mon[28128]: pgmap v495: 129 pgs: 129 active+clean; 94 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:10:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:16 smithi073 ceph-mon[35473]: pgmap v495: 129 pgs: 129 active+clean; 94 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:10:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:17.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 977702 14.36 MB/sec execute 253 sec latency 2758.108 ms 2024-09-10T23:10:17.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 169071 2.40 MB/sec execute 256 sec latency 17.398 ms 2024-09-10T23:10:18.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 977822 14.30 MB/sec execute 254 sec latency 3514.228 ms 2024-09-10T23:10:18.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 169631 2.41 MB/sec execute 257 sec latency 20.400 ms 2024-09-10T23:10:19.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:18 smithi046 ceph-mon[28128]: pgmap v496: 129 pgs: 129 active+clean; 95 MiB data, 802 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:10:19.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:18 smithi073 ceph-mon[35473]: pgmap v496: 129 pgs: 129 active+clean; 95 MiB data, 802 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:10:19.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 981290 14.32 MB/sec execute 255 sec latency 72.310 ms 2024-09-10T23:10:19.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 170052 2.41 MB/sec execute 258 sec latency 20.331 ms 2024-09-10T23:10:20.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 983853 14.32 MB/sec execute 256 sec latency 84.574 ms 2024-09-10T23:10:20.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:20 smithi046 ceph-mon[28128]: pgmap v497: 129 pgs: 129 active+clean; 95 MiB data, 801 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 980 KiB/s wr, 57 op/s 2024-09-10T23:10:20.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 170518 2.41 MB/sec execute 259 sec latency 18.180 ms 2024-09-10T23:10:21.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:20 smithi073 ceph-mon[35473]: pgmap v497: 129 pgs: 129 active+clean; 95 MiB data, 801 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 980 KiB/s wr, 57 op/s 2024-09-10T23:10:21.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 986485 14.31 MB/sec execute 257 sec latency 55.041 ms 2024-09-10T23:10:21.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 170780 2.41 MB/sec execute 260 sec latency 20.120 ms 2024-09-10T23:10:22.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 989289 14.32 MB/sec execute 258 sec latency 49.823 ms 2024-09-10T23:10:22.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 171213 2.40 MB/sec execute 261 sec latency 19.237 ms 2024-09-10T23:10:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:22 smithi046 ceph-mon[28128]: pgmap v498: 129 pgs: 129 active+clean; 95 MiB data, 823 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:10:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:22 smithi073 ceph-mon[35473]: pgmap v498: 129 pgs: 129 active+clean; 95 MiB data, 823 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:10:23.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 990681 14.29 MB/sec execute 259 sec latency 420.327 ms 2024-09-10T23:10:23.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 171726 2.41 MB/sec execute 262 sec latency 17.650 ms 2024-09-10T23:10:24.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 993578 14.29 MB/sec execute 260 sec latency 458.243 ms 2024-09-10T23:10:24.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 172182 2.40 MB/sec execute 263 sec latency 16.404 ms 2024-09-10T23:10:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:24 smithi046 ceph-mon[28128]: pgmap v499: 129 pgs: 129 active+clean; 95 MiB data, 828 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-10T23:10:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:24 smithi073 ceph-mon[35473]: pgmap v499: 129 pgs: 129 active+clean; 95 MiB data, 828 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-10T23:10:25.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 995767 14.29 MB/sec execute 261 sec latency 44.562 ms 2024-09-10T23:10:25.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 172674 2.40 MB/sec execute 264 sec latency 17.213 ms 2024-09-10T23:10:26.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 999129 14.30 MB/sec execute 262 sec latency 116.796 ms 2024-09-10T23:10:26.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 173265 2.41 MB/sec execute 265 sec latency 18.039 ms 2024-09-10T23:10:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:26 smithi046 ceph-mon[28128]: pgmap v500: 129 pgs: 129 active+clean; 96 MiB data, 831 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:10:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:26 smithi073 ceph-mon[35473]: pgmap v500: 129 pgs: 129 active+clean; 96 MiB data, 831 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:10:27.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1002599 14.32 MB/sec execute 263 sec latency 50.116 ms 2024-09-10T23:10:27.880 INFO:tasks.workunit.client.1.smithi073.stdout: 1 173633 2.41 MB/sec execute 266 sec latency 20.654 ms 2024-09-10T23:10:28.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1006090 14.34 MB/sec execute 264 sec latency 65.927 ms 2024-09-10T23:10:28.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 174063 2.41 MB/sec execute 267 sec latency 235.769 ms 2024-09-10T23:10:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:28 smithi046 ceph-mon[28128]: pgmap v501: 129 pgs: 129 active+clean; 95 MiB data, 823 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:10:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:28 smithi073 ceph-mon[35473]: pgmap v501: 129 pgs: 129 active+clean; 95 MiB data, 823 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:10:29.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1006214 14.28 MB/sec execute 265 sec latency 584.894 ms 2024-09-10T23:10:29.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 174305 2.41 MB/sec execute 268 sec latency 313.621 ms 2024-09-10T23:10:30.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1009690 14.30 MB/sec execute 266 sec latency 43.181 ms 2024-09-10T23:10:30.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 174735 2.40 MB/sec execute 269 sec latency 23.100 ms 2024-09-10T23:10:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:30 smithi046 ceph-mon[28128]: pgmap v502: 129 pgs: 129 active+clean; 97 MiB data, 826 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:10:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:30 smithi073 ceph-mon[35473]: pgmap v502: 129 pgs: 129 active+clean; 97 MiB data, 826 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:10:31.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1012294 14.30 MB/sec execute 267 sec latency 55.377 ms 2024-09-10T23:10:31.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 175216 2.41 MB/sec execute 270 sec latency 29.597 ms 2024-09-10T23:10:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:32.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1015503 14.31 MB/sec execute 268 sec latency 61.402 ms 2024-09-10T23:10:32.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 175669 2.40 MB/sec execute 271 sec latency 19.390 ms 2024-09-10T23:10:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:32 smithi046 ceph-mon[28128]: pgmap v503: 129 pgs: 129 active+clean; 97 MiB data, 827 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:10:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:32 smithi073 ceph-mon[35473]: pgmap v503: 129 pgs: 129 active+clean; 97 MiB data, 827 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:10:33.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1018426 14.31 MB/sec execute 269 sec latency 47.587 ms 2024-09-10T23:10:33.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 176163 2.40 MB/sec execute 272 sec latency 17.850 ms 2024-09-10T23:10:34.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1020337 14.30 MB/sec execute 270 sec latency 426.981 ms 2024-09-10T23:10:34.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 176402 2.39 MB/sec execute 273 sec latency 386.333 ms 2024-09-10T23:10:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:34 smithi046 ceph-mon[28128]: pgmap v504: 129 pgs: 129 active+clean; 98 MiB data, 828 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:10:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:34 smithi073 ceph-mon[35473]: pgmap v504: 129 pgs: 129 active+clean; 98 MiB data, 828 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:10:35.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1022899 14.30 MB/sec execute 271 sec latency 666.813 ms 2024-09-10T23:10:35.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 177110 2.41 MB/sec execute 274 sec latency 17.642 ms 2024-09-10T23:10:36.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1025032 14.29 MB/sec execute 272 sec latency 82.294 ms 2024-09-10T23:10:36.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 177481 2.41 MB/sec execute 275 sec latency 15.790 ms 2024-09-10T23:10:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:36 smithi046 ceph-mon[28128]: pgmap v505: 129 pgs: 129 active+clean; 97 MiB data, 828 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:10:37.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:36 smithi073 ceph-mon[35473]: pgmap v505: 129 pgs: 129 active+clean; 97 MiB data, 828 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:10:37.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1027678 14.29 MB/sec execute 273 sec latency 56.667 ms 2024-09-10T23:10:37.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 177791 2.41 MB/sec execute 276 sec latency 19.088 ms 2024-09-10T23:10:38.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1031044 14.30 MB/sec execute 274 sec latency 43.510 ms 2024-09-10T23:10:38.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 178189 2.40 MB/sec execute 277 sec latency 16.495 ms 2024-09-10T23:10:39.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:38 smithi046 ceph-mon[28128]: pgmap v506: 129 pgs: 129 active+clean; 97 MiB data, 834 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:10:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:38 smithi073 ceph-mon[35473]: pgmap v506: 129 pgs: 129 active+clean; 97 MiB data, 834 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:10:39.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1034519 14.32 MB/sec execute 275 sec latency 41.801 ms 2024-09-10T23:10:39.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 178616 2.40 MB/sec execute 278 sec latency 26.302 ms 2024-09-10T23:10:40.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1034668 14.27 MB/sec execute 276 sec latency 583.686 ms 2024-09-10T23:10:40.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 179108 2.40 MB/sec execute 279 sec latency 21.006 ms 2024-09-10T23:10:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:40 smithi046 ceph-mon[28128]: pgmap v507: 129 pgs: 129 active+clean; 98 MiB data, 835 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:10:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:40 smithi073 ceph-mon[35473]: pgmap v507: 129 pgs: 129 active+clean; 98 MiB data, 835 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:10:41.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1038066 14.29 MB/sec execute 277 sec latency 50.176 ms 2024-09-10T23:10:41.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 179626 2.39 MB/sec execute 280 sec latency 17.044 ms 2024-09-10T23:10:42.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1041549 14.30 MB/sec execute 278 sec latency 99.142 ms 2024-09-10T23:10:42.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 180112 2.40 MB/sec execute 281 sec latency 17.774 ms 2024-09-10T23:10:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:42 smithi046 ceph-mon[28128]: pgmap v508: 129 pgs: 129 active+clean; 100 MiB data, 841 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:10:43.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:42 smithi073 ceph-mon[35473]: pgmap v508: 129 pgs: 129 active+clean; 100 MiB data, 841 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:10:43.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1043871 14.30 MB/sec execute 279 sec latency 50.027 ms 2024-09-10T23:10:43.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 180675 2.41 MB/sec execute 282 sec latency 19.102 ms 2024-09-10T23:10:44.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1046793 14.29 MB/sec execute 280 sec latency 49.228 ms 2024-09-10T23:10:44.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 181127 2.41 MB/sec execute 283 sec latency 18.292 ms 2024-09-10T23:10:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:44 smithi046 ceph-mon[28128]: pgmap v509: 129 pgs: 129 active+clean; 100 MiB data, 842 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 964 KiB/s wr, 53 op/s 2024-09-10T23:10:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:44 smithi073 ceph-mon[35473]: pgmap v509: 129 pgs: 129 active+clean; 100 MiB data, 842 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 964 KiB/s wr, 53 op/s 2024-09-10T23:10:45.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1048777 14.29 MB/sec execute 281 sec latency 174.871 ms 2024-09-10T23:10:45.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 181389 2.41 MB/sec execute 284 sec latency 25.228 ms 2024-09-10T23:10:46.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1050229 14.26 MB/sec execute 282 sec latency 563.077 ms 2024-09-10T23:10:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:46 smithi046 ceph-mon[28128]: pgmap v510: 129 pgs: 129 active+clean; 99 MiB data, 846 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-10T23:10:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:46.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 181825 2.40 MB/sec execute 285 sec latency 23.642 ms 2024-09-10T23:10:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:46 smithi073 ceph-mon[35473]: pgmap v510: 129 pgs: 129 active+clean; 99 MiB data, 846 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-10T23:10:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:10:47.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1052392 14.26 MB/sec execute 283 sec latency 94.927 ms 2024-09-10T23:10:47.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 182316 2.41 MB/sec execute 286 sec latency 22.598 ms 2024-09-10T23:10:48.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1055795 14.27 MB/sec execute 284 sec latency 54.361 ms 2024-09-10T23:10:48.881 INFO:tasks.workunit.client.1.smithi073.stdout: 1 182784 2.40 MB/sec execute 287 sec latency 19.560 ms 2024-09-10T23:10:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:48 smithi046 ceph-mon[28128]: pgmap v511: 129 pgs: 129 active+clean; 100 MiB data, 851 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:10:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:48 smithi073 ceph-mon[35473]: pgmap v511: 129 pgs: 129 active+clean; 100 MiB data, 851 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:10:49.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1058251 14.27 MB/sec execute 285 sec latency 154.405 ms 2024-09-10T23:10:49.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 183280 2.40 MB/sec execute 288 sec latency 22.263 ms 2024-09-10T23:10:50.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1060799 14.26 MB/sec execute 286 sec latency 57.388 ms 2024-09-10T23:10:50.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 183849 2.41 MB/sec execute 289 sec latency 20.372 ms 2024-09-10T23:10:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:50 smithi046 ceph-mon[28128]: pgmap v512: 129 pgs: 129 active+clean; 101 MiB data, 851 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:10:51.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:50 smithi073 ceph-mon[35473]: pgmap v512: 129 pgs: 129 active+clean; 101 MiB data, 851 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:10:51.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1062833 14.25 MB/sec execute 287 sec latency 495.369 ms 2024-09-10T23:10:51.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 184243 2.41 MB/sec execute 290 sec latency 19.677 ms 2024-09-10T23:10:52.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1064566 14.23 MB/sec execute 288 sec latency 788.629 ms 2024-09-10T23:10:52.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 184735 2.41 MB/sec execute 291 sec latency 16.474 ms 2024-09-10T23:10:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:52 smithi046 ceph-mon[28128]: pgmap v513: 129 pgs: 129 active+clean; 101 MiB data, 851 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:10:53.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:52 smithi073 ceph-mon[35473]: pgmap v513: 129 pgs: 129 active+clean; 101 MiB data, 851 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:10:53.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1066793 14.23 MB/sec execute 289 sec latency 50.124 ms 2024-09-10T23:10:53.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 185019 2.41 MB/sec execute 292 sec latency 14.364 ms 2024-09-10T23:10:54.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1070048 14.24 MB/sec execute 290 sec latency 61.774 ms 2024-09-10T23:10:54.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 185496 2.40 MB/sec execute 293 sec latency 16.983 ms 2024-09-10T23:10:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:54 smithi046 ceph-mon[28128]: pgmap v514: 129 pgs: 129 active+clean; 99 MiB data, 849 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1000 KiB/s wr, 54 op/s 2024-09-10T23:10:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:54 smithi073 ceph-mon[35473]: pgmap v514: 129 pgs: 129 active+clean; 99 MiB data, 849 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1000 KiB/s wr, 54 op/s 2024-09-10T23:10:55.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1073520 14.26 MB/sec execute 291 sec latency 49.447 ms 2024-09-10T23:10:55.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 185988 2.41 MB/sec execute 294 sec latency 21.110 ms 2024-09-10T23:10:56.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1077009 14.27 MB/sec execute 292 sec latency 62.170 ms 2024-09-10T23:10:56.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 186482 2.40 MB/sec execute 295 sec latency 18.272 ms 2024-09-10T23:10:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:56 smithi046 ceph-mon[28128]: pgmap v515: 129 pgs: 129 active+clean; 102 MiB data, 854 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2024-09-10T23:10:57.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:56 smithi073 ceph-mon[35473]: pgmap v515: 129 pgs: 129 active+clean; 102 MiB data, 854 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2024-09-10T23:10:57.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1077067 14.22 MB/sec execute 293 sec latency 678.244 ms 2024-09-10T23:10:57.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 186924 2.40 MB/sec execute 296 sec latency 17.582 ms 2024-09-10T23:10:58.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1080553 14.24 MB/sec execute 294 sec latency 56.838 ms 2024-09-10T23:10:58.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 187622 2.41 MB/sec execute 297 sec latency 18.885 ms 2024-09-10T23:10:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:58 smithi046 ceph-mon[28128]: pgmap v516: 129 pgs: 129 active+clean; 102 MiB data, 859 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 58 op/s 2024-09-10T23:10:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:58 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:10:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:58 smithi073 ceph-mon[35473]: pgmap v516: 129 pgs: 129 active+clean; 102 MiB data, 859 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 58 op/s 2024-09-10T23:10:59.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:58 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:10:59.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1083172 14.24 MB/sec execute 295 sec latency 51.146 ms 2024-09-10T23:10:59.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 187982 2.42 MB/sec execute 298 sec latency 18.470 ms 2024-09-10T23:11:00.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:11:00.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:11:00.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:10:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:11:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:59 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:11:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:59 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:11:00.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:10:59 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:11:00.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1085899 14.23 MB/sec execute 296 sec latency 58.393 ms 2024-09-10T23:11:00.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 188344 2.41 MB/sec execute 299 sec latency 18.743 ms 2024-09-10T23:11:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:00 smithi046 ceph-mon[28128]: pgmap v517: 129 pgs: 129 active+clean; 103 MiB data, 863 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-09-10T23:11:01.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:00 smithi073 ceph-mon[35473]: pgmap v517: 129 pgs: 129 active+clean; 103 MiB data, 863 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-09-10T23:11:01.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1088851 14.24 MB/sec execute 297 sec latency 50.076 ms 2024-09-10T23:11:01.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 188630 2.40 MB/sec execute 300 sec latency 20.395 ms 2024-09-10T23:11:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:02.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1091252 14.24 MB/sec execute 298 sec latency 267.622 ms 2024-09-10T23:11:02.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 188980 2.40 MB/sec execute 301 sec latency 268.488 ms 2024-09-10T23:11:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:02 smithi073 ceph-mon[35473]: pgmap v518: 129 pgs: 129 active+clean; 103 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:11:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:02 smithi046 ceph-mon[28128]: pgmap v518: 129 pgs: 129 active+clean; 103 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:11:03.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1092402 14.21 MB/sec execute 299 sec latency 533.552 ms 2024-09-10T23:11:03.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 189477 2.41 MB/sec execute 302 sec latency 19.789 ms 2024-09-10T23:11:04.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1094866 14.21 MB/sec execute 300 sec latency 91.858 ms 2024-09-10T23:11:04.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 189962 2.40 MB/sec execute 303 sec latency 17.488 ms 2024-09-10T23:11:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:04 smithi073 ceph-mon[35473]: pgmap v519: 129 pgs: 129 active+clean; 103 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 55 op/s 2024-09-10T23:11:05.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:04 smithi046 ceph-mon[28128]: pgmap v519: 129 pgs: 129 active+clean; 103 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 55 op/s 2024-09-10T23:11:05.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1098342 14.23 MB/sec execute 301 sec latency 54.506 ms 2024-09-10T23:11:05.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 190418 2.40 MB/sec execute 304 sec latency 18.992 ms 2024-09-10T23:11:06.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1101827 14.24 MB/sec execute 302 sec latency 46.292 ms 2024-09-10T23:11:06.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 191015 2.41 MB/sec execute 305 sec latency 16.914 ms 2024-09-10T23:11:07.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:06 smithi046 ceph-mon[28128]: pgmap v520: 129 pgs: 129 active+clean; 103 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:11:07.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:06 smithi073 ceph-mon[35473]: pgmap v520: 129 pgs: 129 active+clean; 103 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:11:07.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1104020 14.23 MB/sec execute 303 sec latency 116.747 ms 2024-09-10T23:11:07.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 191395 2.40 MB/sec execute 306 sec latency 15.891 ms 2024-09-10T23:11:08.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1106586 14.23 MB/sec execute 304 sec latency 58.546 ms 2024-09-10T23:11:08.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 191870 2.41 MB/sec execute 307 sec latency 15.794 ms 2024-09-10T23:11:09.131 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:08 smithi073 ceph-mon[35473]: pgmap v521: 129 pgs: 129 active+clean; 102 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 63 op/s 2024-09-10T23:11:09.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:08 smithi046 ceph-mon[28128]: pgmap v521: 129 pgs: 129 active+clean; 102 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 63 op/s 2024-09-10T23:11:09.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1109224 14.23 MB/sec execute 305 sec latency 39.805 ms 2024-09-10T23:11:09.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 192166 2.40 MB/sec execute 308 sec latency 15.696 ms 2024-09-10T23:11:10.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1112594 14.25 MB/sec execute 306 sec latency 49.428 ms 2024-09-10T23:11:10.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 192641 2.40 MB/sec execute 309 sec latency 17.996 ms 2024-09-10T23:11:11.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:10 smithi046 ceph-mon[28128]: pgmap v522: 129 pgs: 129 active+clean; 103 MiB data, 872 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-09-10T23:11:11.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:10 smithi073 ceph-mon[35473]: pgmap v522: 129 pgs: 129 active+clean; 103 MiB data, 872 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-09-10T23:11:11.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1116066 14.26 MB/sec execute 307 sec latency 58.428 ms 2024-09-10T23:11:11.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 193142 2.41 MB/sec execute 310 sec latency 17.325 ms 2024-09-10T23:11:12.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1118653 14.26 MB/sec execute 308 sec latency 114.584 ms 2024-09-10T23:11:12.882 INFO:tasks.workunit.client.1.smithi073.stdout: 1 193619 2.40 MB/sec execute 311 sec latency 19.186 ms 2024-09-10T23:11:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:12 smithi046 ceph-mon[28128]: pgmap v523: 129 pgs: 129 active+clean; 105 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-10T23:11:13.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:12 smithi073 ceph-mon[35473]: pgmap v523: 129 pgs: 129 active+clean; 105 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-10T23:11:13.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1121293 14.25 MB/sec execute 309 sec latency 67.928 ms 2024-09-10T23:11:13.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 194049 2.40 MB/sec execute 312 sec latency 20.527 ms 2024-09-10T23:11:14.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1124055 14.26 MB/sec execute 310 sec latency 54.765 ms 2024-09-10T23:11:14.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 194818 2.41 MB/sec execute 313 sec latency 18.518 ms 2024-09-10T23:11:15.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:14 smithi046 ceph-mon[28128]: pgmap v524: 129 pgs: 129 active+clean; 105 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 952 KiB/s wr, 57 op/s 2024-09-10T23:11:15.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:14 smithi073 ceph-mon[35473]: pgmap v524: 129 pgs: 129 active+clean; 105 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 952 KiB/s wr, 57 op/s 2024-09-10T23:11:15.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1126853 14.26 MB/sec execute 311 sec latency 46.171 ms 2024-09-10T23:11:15.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 195163 2.41 MB/sec execute 314 sec latency 15.656 ms 2024-09-10T23:11:16.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1130307 14.28 MB/sec execute 312 sec latency 41.615 ms 2024-09-10T23:11:16.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 195499 2.41 MB/sec execute 315 sec latency 15.740 ms 2024-09-10T23:11:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:16 smithi046 ceph-mon[28128]: pgmap v525: 129 pgs: 129 active+clean; 104 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 962 KiB/s wr, 66 op/s 2024-09-10T23:11:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:16 smithi073 ceph-mon[35473]: pgmap v525: 129 pgs: 129 active+clean; 104 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 962 KiB/s wr, 66 op/s 2024-09-10T23:11:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:17.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1133796 14.29 MB/sec execute 313 sec latency 52.358 ms 2024-09-10T23:11:17.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 195855 2.41 MB/sec execute 316 sec latency 21.030 ms 2024-09-10T23:11:18.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1136412 14.29 MB/sec execute 314 sec latency 48.098 ms 2024-09-10T23:11:18.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 196317 2.40 MB/sec execute 317 sec latency 19.909 ms 2024-09-10T23:11:19.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:18 smithi046 ceph-mon[28128]: pgmap v526: 129 pgs: 129 active+clean; 104 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-09-10T23:11:19.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:18 smithi073 ceph-mon[35473]: pgmap v526: 129 pgs: 129 active+clean; 104 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-09-10T23:11:19.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1139000 14.28 MB/sec execute 315 sec latency 51.764 ms 2024-09-10T23:11:19.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 196825 2.41 MB/sec execute 318 sec latency 20.232 ms 2024-09-10T23:11:20.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1141085 14.28 MB/sec execute 316 sec latency 105.698 ms 2024-09-10T23:11:20.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 197311 2.40 MB/sec execute 319 sec latency 21.941 ms 2024-09-10T23:11:21.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:20 smithi046 ceph-mon[28128]: pgmap v527: 129 pgs: 129 active+clean; 106 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:11:21.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:20 smithi073 ceph-mon[35473]: pgmap v527: 129 pgs: 129 active+clean; 106 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:11:21.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1144481 14.29 MB/sec execute 317 sec latency 43.516 ms 2024-09-10T23:11:21.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 197717 2.40 MB/sec execute 320 sec latency 18.925 ms 2024-09-10T23:11:22.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1147974 14.31 MB/sec execute 318 sec latency 54.182 ms 2024-09-10T23:11:22.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 198401 2.41 MB/sec execute 321 sec latency 16.836 ms 2024-09-10T23:11:23.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:22 smithi046 ceph-mon[28128]: pgmap v528: 129 pgs: 129 active+clean; 107 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:11:23.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:22 smithi073 ceph-mon[35473]: pgmap v528: 129 pgs: 129 active+clean; 107 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:11:23.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1149639 14.28 MB/sec execute 319 sec latency 174.173 ms 2024-09-10T23:11:23.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 198841 2.42 MB/sec execute 322 sec latency 18.312 ms 2024-09-10T23:11:24.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1150619 14.26 MB/sec execute 320 sec latency 819.891 ms 2024-09-10T23:11:24.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 199108 2.41 MB/sec execute 323 sec latency 14.232 ms 2024-09-10T23:11:25.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:24 smithi046 ceph-mon[28128]: pgmap v529: 129 pgs: 129 active+clean; 107 MiB data, 893 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1006 KiB/s wr, 57 op/s 2024-09-10T23:11:25.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:24 smithi073 ceph-mon[35473]: pgmap v529: 129 pgs: 129 active+clean; 107 MiB data, 893 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1006 KiB/s wr, 57 op/s 2024-09-10T23:11:25.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1152473 14.25 MB/sec execute 321 sec latency 165.980 ms 2024-09-10T23:11:25.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 199506 2.41 MB/sec execute 324 sec latency 20.730 ms 2024-09-10T23:11:26.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1155194 14.25 MB/sec execute 322 sec latency 45.721 ms 2024-09-10T23:11:26.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 199930 2.40 MB/sec execute 325 sec latency 20.577 ms 2024-09-10T23:11:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:26 smithi046 ceph-mon[28128]: pgmap v530: 129 pgs: 129 active+clean; 106 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 64 op/s 2024-09-10T23:11:27.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:26 smithi073 ceph-mon[35473]: pgmap v530: 129 pgs: 129 active+clean; 106 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 64 op/s 2024-09-10T23:11:27.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1158666 14.26 MB/sec execute 323 sec latency 49.439 ms 2024-09-10T23:11:27.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 200479 2.41 MB/sec execute 326 sec latency 15.316 ms 2024-09-10T23:11:28.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1162156 14.28 MB/sec execute 324 sec latency 55.660 ms 2024-09-10T23:11:28.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 200989 2.40 MB/sec execute 327 sec latency 19.081 ms 2024-09-10T23:11:29.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:28 smithi046 ceph-mon[28128]: pgmap v531: 129 pgs: 129 active+clean; 108 MiB data, 885 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.4 MiB/s wr, 70 op/s 2024-09-10T23:11:29.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:28 smithi073 ceph-mon[35473]: pgmap v531: 129 pgs: 129 active+clean; 108 MiB data, 885 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.4 MiB/s wr, 70 op/s 2024-09-10T23:11:29.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1162464 14.24 MB/sec execute 325 sec latency 408.568 ms 2024-09-10T23:11:29.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 201222 2.40 MB/sec execute 328 sec latency 371.242 ms 2024-09-10T23:11:30.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1165818 14.25 MB/sec execute 326 sec latency 64.708 ms 2024-09-10T23:11:30.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 201929 2.41 MB/sec execute 329 sec latency 21.399 ms 2024-09-10T23:11:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:30 smithi046 ceph-mon[28128]: pgmap v532: 129 pgs: 129 active+clean; 107 MiB data, 883 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 64 op/s 2024-09-10T23:11:31.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:30 smithi073 ceph-mon[35473]: pgmap v532: 129 pgs: 129 active+clean; 107 MiB data, 883 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 64 op/s 2024-09-10T23:11:31.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1169300 14.27 MB/sec execute 327 sec latency 42.635 ms 2024-09-10T23:11:31.883 INFO:tasks.workunit.client.1.smithi073.stdout: 1 202300 2.41 MB/sec execute 330 sec latency 19.435 ms 2024-09-10T23:11:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:32.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1171868 14.26 MB/sec execute 328 sec latency 76.618 ms 2024-09-10T23:11:32.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 202619 2.41 MB/sec execute 331 sec latency 14.234 ms 2024-09-10T23:11:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:32 smithi046 ceph-mon[28128]: pgmap v533: 129 pgs: 129 active+clean; 108 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2024-09-10T23:11:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:32 smithi073 ceph-mon[35473]: pgmap v533: 129 pgs: 129 active+clean; 108 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2024-09-10T23:11:33.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1174001 14.25 MB/sec execute 329 sec latency 100.174 ms 2024-09-10T23:11:33.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 203010 2.40 MB/sec execute 332 sec latency 18.462 ms 2024-09-10T23:11:34.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1176336 14.25 MB/sec execute 330 sec latency 440.171 ms 2024-09-10T23:11:34.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 203470 2.40 MB/sec execute 333 sec latency 16.938 ms 2024-09-10T23:11:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:34 smithi046 ceph-mon[28128]: pgmap v534: 129 pgs: 129 active+clean; 108 MiB data, 888 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.1 MiB/s wr, 52 op/s 2024-09-10T23:11:35.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:34 smithi073 ceph-mon[35473]: pgmap v534: 129 pgs: 129 active+clean; 108 MiB data, 888 MiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.1 MiB/s wr, 52 op/s 2024-09-10T23:11:35.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1176336 14.21 MB/sec execute 331 sec latency 1440.269 ms 2024-09-10T23:11:35.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 204000 2.40 MB/sec execute 334 sec latency 17.713 ms 2024-09-10T23:11:36.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1176336 14.17 MB/sec execute 332 sec latency 2440.345 ms 2024-09-10T23:11:36.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 204486 2.40 MB/sec execute 335 sec latency 21.055 ms 2024-09-10T23:11:37.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:36 smithi046 ceph-mon[28128]: pgmap v535: 129 pgs: 129 active+clean; 110 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 70 op/s 2024-09-10T23:11:37.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:36 smithi073 ceph-mon[35473]: pgmap v535: 129 pgs: 129 active+clean; 110 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 70 op/s 2024-09-10T23:11:37.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1177295 14.14 MB/sec execute 333 sec latency 2800.022 ms 2024-09-10T23:11:37.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 204940 2.41 MB/sec execute 336 sec latency 30.911 ms 2024-09-10T23:11:38.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1180013 14.14 MB/sec execute 334 sec latency 87.672 ms 2024-09-10T23:11:38.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 205497 2.41 MB/sec execute 337 sec latency 18.082 ms 2024-09-10T23:11:39.132 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:38 smithi073 ceph-mon[35473]: pgmap v536: 129 pgs: 129 active+clean; 109 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-09-10T23:11:39.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:38 smithi046 ceph-mon[28128]: pgmap v536: 129 pgs: 129 active+clean; 109 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-09-10T23:11:39.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1183493 14.15 MB/sec execute 335 sec latency 52.754 ms 2024-09-10T23:11:39.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 205946 2.42 MB/sec execute 338 sec latency 16.795 ms 2024-09-10T23:11:40.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1186979 14.17 MB/sec execute 336 sec latency 50.162 ms 2024-09-10T23:11:40.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 206208 2.41 MB/sec execute 339 sec latency 19.009 ms 2024-09-10T23:11:41.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:40 smithi046 ceph-mon[28128]: pgmap v537: 129 pgs: 129 active+clean; 109 MiB data, 889 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1002 KiB/s wr, 65 op/s 2024-09-10T23:11:41.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:40 smithi073 ceph-mon[35473]: pgmap v537: 129 pgs: 129 active+clean; 109 MiB data, 889 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1002 KiB/s wr, 65 op/s 2024-09-10T23:11:41.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1189593 14.17 MB/sec execute 337 sec latency 58.479 ms 2024-09-10T23:11:41.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 206637 2.41 MB/sec execute 340 sec latency 23.005 ms 2024-09-10T23:11:42.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1192318 14.16 MB/sec execute 338 sec latency 48.752 ms 2024-09-10T23:11:42.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 207133 2.41 MB/sec execute 341 sec latency 17.815 ms 2024-09-10T23:11:43.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:42 smithi046 ceph-mon[28128]: pgmap v538: 129 pgs: 129 active+clean; 110 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 64 op/s 2024-09-10T23:11:43.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:42 smithi073 ceph-mon[35473]: pgmap v538: 129 pgs: 129 active+clean; 110 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 64 op/s 2024-09-10T23:11:43.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1195019 14.17 MB/sec execute 339 sec latency 59.659 ms 2024-09-10T23:11:43.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 207603 2.40 MB/sec execute 342 sec latency 16.663 ms 2024-09-10T23:11:44.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1197757 14.17 MB/sec execute 340 sec latency 50.266 ms 2024-09-10T23:11:44.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 208094 2.40 MB/sec execute 343 sec latency 22.213 ms 2024-09-10T23:11:45.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:44 smithi046 ceph-mon[28128]: pgmap v539: 129 pgs: 129 active+clean; 110 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 52 op/s 2024-09-10T23:11:45.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:44 smithi073 ceph-mon[35473]: pgmap v539: 129 pgs: 129 active+clean; 110 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 52 op/s 2024-09-10T23:11:45.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1201205 14.18 MB/sec execute 341 sec latency 107.623 ms 2024-09-10T23:11:45.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 208663 2.41 MB/sec execute 344 sec latency 17.633 ms 2024-09-10T23:11:46.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1203809 14.18 MB/sec execute 342 sec latency 41.419 ms 2024-09-10T23:11:46.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 209062 2.41 MB/sec execute 345 sec latency 18.031 ms 2024-09-10T23:11:47.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:46 smithi046 ceph-mon[28128]: pgmap v540: 129 pgs: 129 active+clean; 111 MiB data, 914 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2024-09-10T23:11:47.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:46 smithi073 ceph-mon[35473]: pgmap v540: 129 pgs: 129 active+clean; 111 MiB data, 914 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2024-09-10T23:11:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:11:47.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1206438 14.18 MB/sec execute 343 sec latency 74.425 ms 2024-09-10T23:11:47.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 209562 2.42 MB/sec execute 346 sec latency 19.459 ms 2024-09-10T23:11:48.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1208553 14.17 MB/sec execute 344 sec latency 107.224 ms 2024-09-10T23:11:48.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 209850 2.41 MB/sec execute 347 sec latency 21.014 ms 2024-09-10T23:11:49.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:48 smithi046 ceph-mon[28128]: pgmap v541: 129 pgs: 129 active+clean; 110 MiB data, 912 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:11:49.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:48 smithi073 ceph-mon[35473]: pgmap v541: 129 pgs: 129 active+clean; 110 MiB data, 912 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:11:49.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1211912 14.19 MB/sec execute 345 sec latency 66.830 ms 2024-09-10T23:11:49.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 210315 2.41 MB/sec execute 348 sec latency 23.079 ms 2024-09-10T23:11:50.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1215338 14.20 MB/sec execute 346 sec latency 135.160 ms 2024-09-10T23:11:50.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 210787 2.41 MB/sec execute 349 sec latency 21.538 ms 2024-09-10T23:11:51.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:50 smithi046 ceph-mon[28128]: pgmap v542: 129 pgs: 129 active+clean; 111 MiB data, 913 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-09-10T23:11:51.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:50 smithi073 ceph-mon[35473]: pgmap v542: 129 pgs: 129 active+clean; 111 MiB data, 913 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-09-10T23:11:51.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1217857 14.20 MB/sec execute 347 sec latency 60.563 ms 2024-09-10T23:11:51.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 211295 2.40 MB/sec execute 350 sec latency 17.625 ms 2024-09-10T23:11:52.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1220587 14.19 MB/sec execute 348 sec latency 46.610 ms 2024-09-10T23:11:52.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 211748 2.40 MB/sec execute 351 sec latency 18.773 ms 2024-09-10T23:11:53.279 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:52 smithi046 ceph-mon[28128]: pgmap v543: 129 pgs: 129 active+clean; 113 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-10T23:11:53.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:52 smithi073 ceph-mon[35473]: pgmap v543: 129 pgs: 129 active+clean; 113 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-10T23:11:53.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1222743 14.19 MB/sec execute 349 sec latency 58.486 ms 2024-09-10T23:11:53.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 212481 2.41 MB/sec execute 352 sec latency 17.293 ms 2024-09-10T23:11:54.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1226106 14.20 MB/sec execute 350 sec latency 54.419 ms 2024-09-10T23:11:54.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 212829 2.42 MB/sec execute 353 sec latency 17.370 ms 2024-09-10T23:11:55.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:54 smithi046 ceph-mon[28128]: pgmap v544: 129 pgs: 129 active+clean; 114 MiB data, 940 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:11:55.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:54 smithi073 ceph-mon[35473]: pgmap v544: 129 pgs: 129 active+clean; 114 MiB data, 940 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:11:55.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1229532 14.22 MB/sec execute 351 sec latency 44.955 ms 2024-09-10T23:11:55.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 213206 2.42 MB/sec execute 354 sec latency 14.125 ms 2024-09-10T23:11:56.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1232146 14.22 MB/sec execute 352 sec latency 59.371 ms 2024-09-10T23:11:56.884 INFO:tasks.workunit.client.1.smithi073.stdout: 1 213531 2.41 MB/sec execute 355 sec latency 21.736 ms 2024-09-10T23:11:57.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:56 smithi046 ceph-mon[28128]: pgmap v545: 129 pgs: 129 active+clean; 112 MiB data, 960 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:11:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:56 smithi073 ceph-mon[35473]: pgmap v545: 129 pgs: 129 active+clean; 112 MiB data, 960 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:11:57.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1234770 14.21 MB/sec execute 353 sec latency 59.985 ms 2024-09-10T23:11:57.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 213994 2.41 MB/sec execute 356 sec latency 23.092 ms 2024-09-10T23:11:58.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1236924 14.21 MB/sec execute 354 sec latency 56.001 ms 2024-09-10T23:11:58.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 214488 2.41 MB/sec execute 357 sec latency 18.208 ms 2024-09-10T23:11:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:58 smithi046 ceph-mon[28128]: pgmap v546: 129 pgs: 129 active+clean; 114 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2024-09-10T23:11:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:58 smithi073 ceph-mon[35473]: pgmap v546: 129 pgs: 129 active+clean; 114 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2024-09-10T23:11:59.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1240227 14.22 MB/sec execute 355 sec latency 110.393 ms 2024-09-10T23:11:59.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 215035 2.41 MB/sec execute 358 sec latency 19.072 ms 2024-09-10T23:12:00.220 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:11:59 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:12:00.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:11:59 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:12:00.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1243707 14.23 MB/sec execute 356 sec latency 49.348 ms 2024-09-10T23:12:00.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 215478 2.40 MB/sec execute 359 sec latency 17.324 ms 2024-09-10T23:12:01.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: pgmap v547: 129 pgs: 129 active+clean; 114 MiB data, 972 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: Adjusting osd_memory_target on smithi073 to 1680M 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:12:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: pgmap v547: 129 pgs: 129 active+clean; 114 MiB data, 972 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: Adjusting osd_memory_target on smithi073 to 1680M 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:12:01.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:12:01.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1246005 14.23 MB/sec execute 357 sec latency 74.600 ms 2024-09-10T23:12:01.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 216171 2.42 MB/sec execute 360 sec latency 20.450 ms 2024-09-10T23:12:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:01 smithi046 ceph-mon[28128]: pgmap v548: 129 pgs: 129 active+clean; 114 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:12:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:02.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:01 smithi073 ceph-mon[35473]: pgmap v548: 129 pgs: 129 active+clean; 114 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-10T23:12:02.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:02.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1247383 14.21 MB/sec execute 358 sec latency 287.632 ms 2024-09-10T23:12:02.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 216552 2.42 MB/sec execute 361 sec latency 18.726 ms 2024-09-10T23:12:03.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1249497 14.20 MB/sec execute 359 sec latency 800.089 ms 2024-09-10T23:12:03.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 216865 2.42 MB/sec execute 362 sec latency 18.793 ms 2024-09-10T23:12:04.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:04 smithi046 ceph-mon[28128]: pgmap v549: 129 pgs: 129 active+clean; 114 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-10T23:12:04.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:04 smithi073 ceph-mon[35473]: pgmap v549: 129 pgs: 129 active+clean; 114 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-10T23:12:04.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1252008 14.19 MB/sec execute 360 sec latency 52.072 ms 2024-09-10T23:12:04.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 217256 2.41 MB/sec execute 363 sec latency 19.337 ms 2024-09-10T23:12:05.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1254591 14.19 MB/sec execute 361 sec latency 58.266 ms 2024-09-10T23:12:05.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 217709 2.41 MB/sec execute 364 sec latency 19.800 ms 2024-09-10T23:12:06.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:06 smithi073 ceph-mon[35473]: pgmap v550: 129 pgs: 129 active+clean; 114 MiB data, 973 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:12:06.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:06 smithi046 ceph-mon[28128]: pgmap v550: 129 pgs: 129 active+clean; 114 MiB data, 973 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:12:06.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1257951 14.21 MB/sec execute 362 sec latency 103.872 ms 2024-09-10T23:12:06.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 218242 2.41 MB/sec execute 365 sec latency 18.766 ms 2024-09-10T23:12:07.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1261441 14.22 MB/sec execute 363 sec latency 49.094 ms 2024-09-10T23:12:07.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 218757 2.41 MB/sec execute 366 sec latency 16.093 ms 2024-09-10T23:12:08.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:08 smithi046 ceph-mon[28128]: pgmap v551: 129 pgs: 129 active+clean; 116 MiB data, 978 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:12:08.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:08 smithi073 ceph-mon[35473]: pgmap v551: 129 pgs: 129 active+clean; 116 MiB data, 978 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:12:08.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1261561 14.18 MB/sec execute 364 sec latency 728.163 ms 2024-09-10T23:12:08.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 218857 2.40 MB/sec execute 367 sec latency 684.802 ms 2024-09-10T23:12:09.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1261561 14.14 MB/sec execute 365 sec latency 1728.233 ms 2024-09-10T23:12:09.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 218857 2.40 MB/sec execute 368 sec latency 1684.914 ms 2024-09-10T23:12:10.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1261561 14.10 MB/sec execute 366 sec latency 2728.287 ms 2024-09-10T23:12:10.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 218857 2.39 MB/sec execute 369 sec latency 2685.039 ms 2024-09-10T23:12:11.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:11 smithi073 ceph-mon[35473]: pgmap v552: 129 pgs: 129 active+clean; 115 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 989 KiB/s wr, 59 op/s 2024-09-10T23:12:11.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:11 smithi046 ceph-mon[28128]: pgmap v552: 129 pgs: 129 active+clean; 115 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 989 KiB/s wr, 59 op/s 2024-09-10T23:12:11.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1263233 14.09 MB/sec execute 367 sec latency 3165.655 ms 2024-09-10T23:12:11.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 219387 2.40 MB/sec execute 370 sec latency 2785.281 ms 2024-09-10T23:12:12.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:12 smithi046 ceph-mon[28128]: pgmap v553: 129 pgs: 129 active+clean; 114 MiB data, 972 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 68 op/s 2024-09-10T23:12:12.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:12 smithi073 ceph-mon[35473]: pgmap v553: 129 pgs: 129 active+clean; 114 MiB data, 972 MiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 68 op/s 2024-09-10T23:12:12.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1266033 14.09 MB/sec execute 368 sec latency 42.610 ms 2024-09-10T23:12:12.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 219756 2.40 MB/sec execute 371 sec latency 20.465 ms 2024-09-10T23:12:13.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1268729 14.09 MB/sec execute 369 sec latency 66.829 ms 2024-09-10T23:12:13.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 220247 2.40 MB/sec execute 372 sec latency 19.701 ms 2024-09-10T23:12:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:14 smithi046 ceph-mon[28128]: pgmap v554: 129 pgs: 129 active+clean; 114 MiB data, 972 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 890 KiB/s wr, 57 op/s 2024-09-10T23:12:14.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:14 smithi073 ceph-mon[35473]: pgmap v554: 129 pgs: 129 active+clean; 114 MiB data, 972 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 890 KiB/s wr, 57 op/s 2024-09-10T23:12:14.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1272123 14.11 MB/sec execute 370 sec latency 81.853 ms 2024-09-10T23:12:14.885 INFO:tasks.workunit.client.1.smithi073.stdout: 1 220545 2.40 MB/sec execute 373 sec latency 17.927 ms 2024-09-10T23:12:15.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1274725 14.11 MB/sec execute 371 sec latency 50.001 ms 2024-09-10T23:12:15.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 221015 2.39 MB/sec execute 374 sec latency 16.587 ms 2024-09-10T23:12:16.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:16 smithi046 ceph-mon[28128]: pgmap v555: 129 pgs: 129 active+clean; 116 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 2.8 KiB/s rd, 934 KiB/s wr, 56 op/s 2024-09-10T23:12:16.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:16 smithi073 ceph-mon[35473]: pgmap v555: 129 pgs: 129 active+clean; 116 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 2.8 KiB/s rd, 934 KiB/s wr, 56 op/s 2024-09-10T23:12:16.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1277355 14.10 MB/sec execute 372 sec latency 58.464 ms 2024-09-10T23:12:16.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 221496 2.40 MB/sec execute 375 sec latency 16.096 ms 2024-09-10T23:12:17.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:17.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:17.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1280119 14.11 MB/sec execute 373 sec latency 48.188 ms 2024-09-10T23:12:17.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 221947 2.39 MB/sec execute 376 sec latency 22.393 ms 2024-09-10T23:12:18.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:18 smithi046 ceph-mon[28128]: pgmap v556: 129 pgs: 129 active+clean; 117 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:12:18.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:18 smithi073 ceph-mon[35473]: pgmap v556: 129 pgs: 129 active+clean; 117 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:12:18.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1282911 14.11 MB/sec execute 374 sec latency 57.258 ms 2024-09-10T23:12:18.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 222402 2.39 MB/sec execute 377 sec latency 20.029 ms 2024-09-10T23:12:19.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1286316 14.12 MB/sec execute 375 sec latency 57.692 ms 2024-09-10T23:12:19.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 223129 2.40 MB/sec execute 378 sec latency 18.974 ms 2024-09-10T23:12:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:20 smithi046 ceph-mon[28128]: pgmap v557: 129 pgs: 129 active+clean; 117 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 721 KiB/s wr, 37 op/s 2024-09-10T23:12:20.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:20 smithi073 ceph-mon[35473]: pgmap v557: 129 pgs: 129 active+clean; 117 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 721 KiB/s wr, 37 op/s 2024-09-10T23:12:20.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1289801 14.13 MB/sec execute 376 sec latency 66.490 ms 2024-09-10T23:12:20.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 223474 2.40 MB/sec execute 379 sec latency 17.924 ms 2024-09-10T23:12:21.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1291886 14.13 MB/sec execute 377 sec latency 149.472 ms 2024-09-10T23:12:21.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 223868 2.40 MB/sec execute 380 sec latency 15.048 ms 2024-09-10T23:12:22.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:22 smithi046 ceph-mon[28128]: pgmap v558: 129 pgs: 129 active+clean; 118 MiB data, 1005 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:12:22.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:22 smithi073 ceph-mon[35473]: pgmap v558: 129 pgs: 129 active+clean; 118 MiB data, 1005 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2024-09-10T23:12:22.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1294302 14.12 MB/sec execute 378 sec latency 81.486 ms 2024-09-10T23:12:22.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 224174 2.40 MB/sec execute 381 sec latency 20.578 ms 2024-09-10T23:12:23.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1297137 14.13 MB/sec execute 379 sec latency 50.393 ms 2024-09-10T23:12:23.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 224634 2.39 MB/sec execute 382 sec latency 22.115 ms 2024-09-10T23:12:24.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:24 smithi046 ceph-mon[28128]: pgmap v559: 129 pgs: 129 active+clean; 118 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-09-10T23:12:24.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:24 smithi073 ceph-mon[35473]: pgmap v559: 129 pgs: 129 active+clean; 118 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-09-10T23:12:24.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1300595 14.14 MB/sec execute 380 sec latency 45.096 ms 2024-09-10T23:12:24.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 225105 2.40 MB/sec execute 383 sec latency 27.051 ms 2024-09-10T23:12:25.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1304097 14.15 MB/sec execute 381 sec latency 47.968 ms 2024-09-10T23:12:25.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 225569 2.39 MB/sec execute 384 sec latency 18.320 ms 2024-09-10T23:12:26.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:26 smithi046 ceph-mon[28128]: pgmap v560: 129 pgs: 129 active+clean; 119 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-09-10T23:12:26.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:26 smithi073 ceph-mon[35473]: pgmap v560: 129 pgs: 129 active+clean; 119 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-09-10T23:12:26.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1306700 14.15 MB/sec execute 382 sec latency 49.636 ms 2024-09-10T23:12:26.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 226009 2.39 MB/sec execute 385 sec latency 17.814 ms 2024-09-10T23:12:27.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1309826 14.16 MB/sec execute 383 sec latency 49.256 ms 2024-09-10T23:12:27.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 226778 2.40 MB/sec execute 386 sec latency 14.728 ms 2024-09-10T23:12:28.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:28 smithi046 ceph-mon[28128]: pgmap v561: 129 pgs: 129 active+clean; 119 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:12:28.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:28 smithi073 ceph-mon[35473]: pgmap v561: 129 pgs: 129 active+clean; 119 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:12:28.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1312349 14.15 MB/sec execute 384 sec latency 45.798 ms 2024-09-10T23:12:28.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 227087 2.40 MB/sec execute 387 sec latency 16.466 ms 2024-09-10T23:12:29.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1314881 14.15 MB/sec execute 385 sec latency 75.033 ms 2024-09-10T23:12:29.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 227453 2.40 MB/sec execute 388 sec latency 14.116 ms 2024-09-10T23:12:30.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:30 smithi046 ceph-mon[28128]: pgmap v562: 129 pgs: 129 active+clean; 119 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 924 KiB/s wr, 58 op/s 2024-09-10T23:12:30.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:30 smithi073 ceph-mon[35473]: pgmap v562: 129 pgs: 129 active+clean; 119 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 924 KiB/s wr, 58 op/s 2024-09-10T23:12:30.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1318291 14.17 MB/sec execute 386 sec latency 50.299 ms 2024-09-10T23:12:30.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 227805 2.40 MB/sec execute 389 sec latency 18.288 ms 2024-09-10T23:12:31.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1321770 14.18 MB/sec execute 387 sec latency 64.327 ms 2024-09-10T23:12:31.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 228262 2.39 MB/sec execute 390 sec latency 20.045 ms 2024-09-10T23:12:32.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:32 smithi046 ceph-mon[28128]: pgmap v563: 129 pgs: 129 active+clean; 120 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:12:32.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:32.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:32 smithi073 ceph-mon[35473]: pgmap v563: 129 pgs: 129 active+clean; 120 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:12:32.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:32.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1323506 14.16 MB/sec execute 388 sec latency 54.662 ms 2024-09-10T23:12:32.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 228769 2.40 MB/sec execute 391 sec latency 16.311 ms 2024-09-10T23:12:33.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1326275 14.17 MB/sec execute 389 sec latency 50.106 ms 2024-09-10T23:12:33.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 229262 2.39 MB/sec execute 392 sec latency 17.694 ms 2024-09-10T23:12:34.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:34 smithi046 ceph-mon[28128]: pgmap v564: 129 pgs: 129 active+clean; 120 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-09-10T23:12:34.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:34 smithi073 ceph-mon[35473]: pgmap v564: 129 pgs: 129 active+clean; 120 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-09-10T23:12:34.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1329063 14.17 MB/sec execute 390 sec latency 49.570 ms 2024-09-10T23:12:34.886 INFO:tasks.workunit.client.1.smithi073.stdout: 1 229676 2.39 MB/sec execute 393 sec latency 18.826 ms 2024-09-10T23:12:35.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1332473 14.18 MB/sec execute 391 sec latency 44.564 ms 2024-09-10T23:12:35.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 230362 2.40 MB/sec execute 394 sec latency 15.159 ms 2024-09-10T23:12:36.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:36 smithi046 ceph-mon[28128]: pgmap v565: 129 pgs: 129 active+clean; 120 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 63 op/s 2024-09-10T23:12:36.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:36 smithi073 ceph-mon[35473]: pgmap v565: 129 pgs: 129 active+clean; 120 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.0 MiB/s wr, 63 op/s 2024-09-10T23:12:36.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1335953 14.19 MB/sec execute 392 sec latency 86.019 ms 2024-09-10T23:12:36.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 230802 2.41 MB/sec execute 395 sec latency 20.193 ms 2024-09-10T23:12:37.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1336158 14.16 MB/sec execute 393 sec latency 596.533 ms 2024-09-10T23:12:37.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 231071 2.40 MB/sec execute 396 sec latency 15.616 ms 2024-09-10T23:12:38.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:38 smithi046 ceph-mon[28128]: pgmap v566: 129 pgs: 129 active+clean; 121 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 64 op/s 2024-09-10T23:12:38.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:38 smithi073 ceph-mon[35473]: pgmap v566: 129 pgs: 129 active+clean; 121 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.2 MiB/s wr, 64 op/s 2024-09-10T23:12:38.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1339622 14.17 MB/sec execute 394 sec latency 48.630 ms 2024-09-10T23:12:38.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 231495 2.40 MB/sec execute 397 sec latency 24.881 ms 2024-09-10T23:12:39.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1343096 14.18 MB/sec execute 395 sec latency 55.371 ms 2024-09-10T23:12:39.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 231992 2.40 MB/sec execute 398 sec latency 16.147 ms 2024-09-10T23:12:40.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:40 smithi046 ceph-mon[28128]: pgmap v567: 129 pgs: 129 active+clean; 121 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:12:40.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:40 smithi073 ceph-mon[35473]: pgmap v567: 129 pgs: 129 active+clean; 121 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:12:40.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1345557 14.18 MB/sec execute 396 sec latency 217.631 ms 2024-09-10T23:12:40.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 232459 2.40 MB/sec execute 399 sec latency 16.974 ms 2024-09-10T23:12:41.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1348287 14.18 MB/sec execute 397 sec latency 45.622 ms 2024-09-10T23:12:41.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 232943 2.39 MB/sec execute 400 sec latency 36.348 ms 2024-09-10T23:12:42.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:42 smithi046 ceph-mon[28128]: pgmap v568: 129 pgs: 129 active+clean; 123 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-10T23:12:42.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:42 smithi073 ceph-mon[35473]: pgmap v568: 129 pgs: 129 active+clean; 123 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-10T23:12:42.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1348676 14.15 MB/sec execute 398 sec latency 542.122 ms 2024-09-10T23:12:42.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 233476 2.40 MB/sec execute 401 sec latency 18.864 ms 2024-09-10T23:12:43.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1348676 14.11 MB/sec execute 399 sec latency 1542.178 ms 2024-09-10T23:12:43.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 233887 2.40 MB/sec execute 402 sec latency 341.777 ms 2024-09-10T23:12:44.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:44 smithi046 ceph-mon[28128]: pgmap v569: 129 pgs: 129 active+clean; 121 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 KiB/s wr, 58 op/s 2024-09-10T23:12:44.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:44 smithi073 ceph-mon[35473]: pgmap v569: 129 pgs: 129 active+clean; 121 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 KiB/s wr, 58 op/s 2024-09-10T23:12:44.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1348829 14.08 MB/sec execute 400 sec latency 1671.147 ms 2024-09-10T23:12:44.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 234146 2.40 MB/sec execute 403 sec latency 168.356 ms 2024-09-10T23:12:45.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1348889 14.05 MB/sec execute 401 sec latency 1513.285 ms 2024-09-10T23:12:45.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 234462 2.40 MB/sec execute 404 sec latency 337.564 ms 2024-09-10T23:12:46.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:46 smithi046 ceph-mon[28128]: pgmap v570: 129 pgs: 129 active+clean; 122 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:12:46.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:46 smithi073 ceph-mon[35473]: pgmap v570: 129 pgs: 129 active+clean; 122 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:12:46.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1351346 14.04 MB/sec execute 402 sec latency 457.801 ms 2024-09-10T23:12:46.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 234760 2.40 MB/sec execute 405 sec latency 17.754 ms 2024-09-10T23:12:47.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:47.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:12:47.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1353925 14.04 MB/sec execute 403 sec latency 66.284 ms 2024-09-10T23:12:47.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 235207 2.39 MB/sec execute 406 sec latency 18.284 ms 2024-09-10T23:12:48.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:48 smithi046 ceph-mon[28128]: pgmap v571: 129 pgs: 129 active+clean; 123 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:12:48.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:48 smithi073 ceph-mon[35473]: pgmap v571: 129 pgs: 129 active+clean; 123 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:12:48.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1357346 14.06 MB/sec execute 404 sec latency 49.241 ms 2024-09-10T23:12:48.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 235708 2.40 MB/sec execute 407 sec latency 19.982 ms 2024-09-10T23:12:49.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1360781 14.07 MB/sec execute 405 sec latency 49.396 ms 2024-09-10T23:12:49.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 236193 2.39 MB/sec execute 408 sec latency 19.648 ms 2024-09-10T23:12:50.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:50 smithi046 ceph-mon[28128]: pgmap v572: 129 pgs: 129 active+clean; 123 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 979 KiB/s wr, 52 op/s 2024-09-10T23:12:50.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:50 smithi073 ceph-mon[35473]: pgmap v572: 129 pgs: 129 active+clean; 123 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 979 KiB/s wr, 52 op/s 2024-09-10T23:12:50.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1363011 14.06 MB/sec execute 406 sec latency 232.876 ms 2024-09-10T23:12:50.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 236619 2.39 MB/sec execute 409 sec latency 19.674 ms 2024-09-10T23:12:51.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1364435 14.05 MB/sec execute 407 sec latency 737.523 ms 2024-09-10T23:12:51.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 237330 2.40 MB/sec execute 410 sec latency 18.001 ms 2024-09-10T23:12:52.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:52 smithi046 ceph-mon[28128]: pgmap v573: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:12:52.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:52 smithi073 ceph-mon[35473]: pgmap v573: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:12:52.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1367571 14.06 MB/sec execute 408 sec latency 115.399 ms 2024-09-10T23:12:52.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 237673 2.40 MB/sec execute 411 sec latency 18.516 ms 2024-09-10T23:12:53.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1370180 14.05 MB/sec execute 409 sec latency 58.407 ms 2024-09-10T23:12:53.887 INFO:tasks.workunit.client.1.smithi073.stdout: 1 238052 2.40 MB/sec execute 412 sec latency 16.236 ms 2024-09-10T23:12:54.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:54 smithi046 ceph-mon[28128]: pgmap v574: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 980 KiB/s wr, 51 op/s 2024-09-10T23:12:54.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:54 smithi073 ceph-mon[35473]: pgmap v574: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 980 KiB/s wr, 51 op/s 2024-09-10T23:12:54.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1373104 14.05 MB/sec execute 410 sec latency 44.314 ms 2024-09-10T23:12:54.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 238363 2.40 MB/sec execute 413 sec latency 20.079 ms 2024-09-10T23:12:55.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1375830 14.10 MB/sec execute 411 sec latency 47.408 ms 2024-09-10T23:12:55.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 238838 2.39 MB/sec execute 414 sec latency 21.964 ms 2024-09-10T23:12:56.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:56 smithi046 ceph-mon[28128]: pgmap v575: 129 pgs: 129 active+clean; 123 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.0 MiB/s wr, 58 op/s 2024-09-10T23:12:56.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:56 smithi073 ceph-mon[35473]: pgmap v575: 129 pgs: 129 active+clean; 123 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.0 MiB/s wr, 58 op/s 2024-09-10T23:12:56.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1377408 14.08 MB/sec execute 412 sec latency 368.069 ms 2024-09-10T23:12:56.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 239318 2.40 MB/sec execute 415 sec latency 21.054 ms 2024-09-10T23:12:57.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1379475 14.08 MB/sec execute 413 sec latency 639.649 ms 2024-09-10T23:12:57.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 239809 2.39 MB/sec execute 416 sec latency 17.924 ms 2024-09-10T23:12:58.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:12:58 smithi046 ceph-mon[28128]: pgmap v576: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:12:58.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:12:58 smithi073 ceph-mon[35473]: pgmap v576: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-10T23:12:58.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1382934 14.09 MB/sec execute 414 sec latency 56.472 ms 2024-09-10T23:12:58.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 240275 2.39 MB/sec execute 417 sec latency 19.102 ms 2024-09-10T23:12:59.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1386413 14.10 MB/sec execute 415 sec latency 48.955 ms 2024-09-10T23:12:59.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 240984 2.40 MB/sec execute 418 sec latency 18.578 ms 2024-09-10T23:13:00.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:00 smithi046 ceph-mon[28128]: pgmap v577: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 983 KiB/s wr, 57 op/s 2024-09-10T23:13:00.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:00 smithi073 ceph-mon[35473]: pgmap v577: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 983 KiB/s wr, 57 op/s 2024-09-10T23:13:00.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1389010 14.10 MB/sec execute 416 sec latency 92.515 ms 2024-09-10T23:13:00.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 241348 2.40 MB/sec execute 419 sec latency 19.122 ms 2024-09-10T23:13:01.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:13:01.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:13:01.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1391604 14.10 MB/sec execute 417 sec latency 107.118 ms 2024-09-10T23:13:01.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 241658 2.40 MB/sec execute 420 sec latency 17.196 ms 2024-09-10T23:13:02.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:02 smithi046 ceph-mon[28128]: pgmap v578: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:13:02.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:02.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:02 smithi073 ceph-mon[35473]: pgmap v578: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:13:02.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:02.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1393517 14.09 MB/sec execute 418 sec latency 90.399 ms 2024-09-10T23:13:02.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 242039 2.40 MB/sec execute 421 sec latency 16.878 ms 2024-09-10T23:13:03.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1395294 14.08 MB/sec execute 419 sec latency 150.453 ms 2024-09-10T23:13:03.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 242468 2.39 MB/sec execute 422 sec latency 18.217 ms 2024-09-10T23:13:04.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:04 smithi046 ceph-mon[28128]: pgmap v579: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:13:04.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:04 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:04.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:04 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:04.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:04 smithi073 ceph-mon[35473]: pgmap v579: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:13:04.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:04.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:04.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1397162 14.07 MB/sec execute 420 sec latency 93.604 ms 2024-09-10T23:13:04.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 242952 2.40 MB/sec execute 423 sec latency 18.143 ms 2024-09-10T23:13:05.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1398835 14.06 MB/sec execute 421 sec latency 133.708 ms 2024-09-10T23:13:05.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 243463 2.39 MB/sec execute 424 sec latency 20.257 ms 2024-09-10T23:13:06.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:06 smithi046 ceph-mon[28128]: pgmap v580: 129 pgs: 129 active+clean; 126 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 MiB/s wr, 60 op/s 2024-09-10T23:13:06.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:06 smithi073 ceph-mon[35473]: pgmap v580: 129 pgs: 129 active+clean; 126 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.1 MiB/s wr, 60 op/s 2024-09-10T23:13:06.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1400709 14.05 MB/sec execute 422 sec latency 65.257 ms 2024-09-10T23:13:06.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 243894 2.39 MB/sec execute 425 sec latency 19.356 ms 2024-09-10T23:13:07.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1403100 14.05 MB/sec execute 423 sec latency 64.909 ms 2024-09-10T23:13:07.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 244546 2.40 MB/sec execute 426 sec latency 16.530 ms 2024-09-10T23:13:08.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:08 smithi046 ceph-mon[28128]: pgmap v581: 129 pgs: 129 active+clean; 126 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:13:08.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:08.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:08 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:08.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:08 smithi073 ceph-mon[35473]: pgmap v581: 129 pgs: 129 active+clean; 126 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-10T23:13:08.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:08.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:08 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:08.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1406368 14.06 MB/sec execute 424 sec latency 44.288 ms 2024-09-10T23:13:08.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 244963 2.40 MB/sec execute 427 sec latency 18.819 ms 2024-09-10T23:13:09.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:13:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:13:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:09 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:09.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:13:09.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:13:09.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:09 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:13:09.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1409414 14.06 MB/sec execute 425 sec latency 81.248 ms 2024-09-10T23:13:09.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 245244 2.40 MB/sec execute 428 sec latency 17.467 ms 2024-09-10T23:13:10.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:10 smithi046 ceph-mon[28128]: pgmap v582: 129 pgs: 129 active+clean; 126 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 970 KiB/s wr, 56 op/s 2024-09-10T23:13:10.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:10 smithi073 ceph-mon[35473]: pgmap v582: 129 pgs: 129 active+clean; 126 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 970 KiB/s wr, 56 op/s 2024-09-10T23:13:10.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1412432 14.06 MB/sec execute 426 sec latency 58.452 ms 2024-09-10T23:13:10.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 245654 2.40 MB/sec execute 429 sec latency 17.356 ms 2024-09-10T23:13:11.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1415576 14.08 MB/sec execute 427 sec latency 55.452 ms 2024-09-10T23:13:11.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 246075 2.39 MB/sec execute 430 sec latency 32.007 ms 2024-09-10T23:13:12.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:12 smithi073 ceph-mon[35473]: pgmap v583: 129 pgs: 129 active+clean; 128 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:13:12.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:12 smithi046 ceph-mon[28128]: pgmap v583: 129 pgs: 129 active+clean; 128 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:13:12.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1418553 14.08 MB/sec execute 428 sec latency 50.138 ms 2024-09-10T23:13:12.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 246618 2.40 MB/sec execute 431 sec latency 18.052 ms 2024-09-10T23:13:13.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1421987 14.09 MB/sec execute 429 sec latency 49.720 ms 2024-09-10T23:13:13.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 247123 2.39 MB/sec execute 432 sec latency 17.392 ms 2024-09-10T23:13:14.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1425462 14.10 MB/sec execute 430 sec latency 46.410 ms 2024-09-10T23:13:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:14 smithi046 ceph-mon[28128]: pgmap v584: 129 pgs: 129 active+clean; 128 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:13:14.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:14 smithi073 ceph-mon[35473]: pgmap v584: 129 pgs: 129 active+clean; 128 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:13:14.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 247657 2.40 MB/sec execute 433 sec latency 19.573 ms 2024-09-10T23:13:15.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1428954 14.11 MB/sec execute 431 sec latency 54.981 ms 2024-09-10T23:13:15.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 248108 2.40 MB/sec execute 434 sec latency 15.824 ms 2024-09-10T23:13:16.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1432391 14.12 MB/sec execute 432 sec latency 41.594 ms 2024-09-10T23:13:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:16 smithi046 ceph-mon[28128]: pgmap v585: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:13:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:16 smithi073 ceph-mon[35473]: pgmap v585: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:13:16.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:16.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 248574 2.40 MB/sec execute 435 sec latency 19.785 ms 2024-09-10T23:13:17.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1432620 14.09 MB/sec execute 433 sec latency 484.581 ms 2024-09-10T23:13:17.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 248840 2.40 MB/sec execute 436 sec latency 18.164 ms 2024-09-10T23:13:18.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1434808 14.09 MB/sec execute 434 sec latency 821.943 ms 2024-09-10T23:13:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:18 smithi046 ceph-mon[28128]: pgmap v586: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:13:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:18 smithi073 ceph-mon[35473]: pgmap v586: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:13:18.888 INFO:tasks.workunit.client.1.smithi073.stdout: 1 249276 2.40 MB/sec execute 437 sec latency 19.654 ms 2024-09-10T23:13:19.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1437739 14.08 MB/sec execute 435 sec latency 116.394 ms 2024-09-10T23:13:19.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 249795 2.40 MB/sec execute 438 sec latency 19.689 ms 2024-09-10T23:13:20.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1440389 14.09 MB/sec execute 436 sec latency 49.761 ms 2024-09-10T23:13:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:20 smithi046 ceph-mon[28128]: pgmap v587: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.0 MiB/s wr, 56 op/s 2024-09-10T23:13:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:20 smithi073 ceph-mon[35473]: pgmap v587: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.0 MiB/s wr, 56 op/s 2024-09-10T23:13:20.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 250248 2.40 MB/sec execute 439 sec latency 19.026 ms 2024-09-10T23:13:21.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1443260 14.09 MB/sec execute 437 sec latency 108.285 ms 2024-09-10T23:13:21.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 250740 2.39 MB/sec execute 440 sec latency 20.814 ms 2024-09-10T23:13:22.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1446734 14.10 MB/sec execute 438 sec latency 54.882 ms 2024-09-10T23:13:22.772 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:22 smithi046 ceph-mon[28128]: pgmap v588: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:13:22.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:22 smithi073 ceph-mon[35473]: pgmap v588: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:13:22.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 251322 2.40 MB/sec execute 441 sec latency 17.881 ms 2024-09-10T23:13:23.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1446984 14.07 MB/sec execute 439 sec latency 314.683 ms 2024-09-10T23:13:23.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 251699 2.40 MB/sec execute 442 sec latency 19.366 ms 2024-09-10T23:13:24.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1450320 14.08 MB/sec execute 440 sec latency 457.534 ms 2024-09-10T23:13:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:24 smithi046 ceph-mon[28128]: pgmap v589: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 996 KiB/s wr, 56 op/s 2024-09-10T23:13:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:24 smithi073 ceph-mon[35473]: pgmap v589: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 996 KiB/s wr, 56 op/s 2024-09-10T23:13:24.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 252190 2.40 MB/sec execute 443 sec latency 18.470 ms 2024-09-10T23:13:25.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1453804 14.09 MB/sec execute 441 sec latency 60.283 ms 2024-09-10T23:13:25.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 252493 2.40 MB/sec execute 444 sec latency 17.612 ms 2024-09-10T23:13:26.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1456444 14.09 MB/sec execute 442 sec latency 58.570 ms 2024-09-10T23:13:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:26 smithi046 ceph-mon[28128]: pgmap v590: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 63 op/s 2024-09-10T23:13:26.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:26 smithi073 ceph-mon[35473]: pgmap v590: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 63 op/s 2024-09-10T23:13:26.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 252952 2.40 MB/sec execute 445 sec latency 25.925 ms 2024-09-10T23:13:27.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1459014 14.09 MB/sec execute 443 sec latency 58.590 ms 2024-09-10T23:13:27.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 253456 2.40 MB/sec execute 446 sec latency 18.644 ms 2024-09-10T23:13:28.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1461018 14.09 MB/sec execute 444 sec latency 205.032 ms 2024-09-10T23:13:28.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:28 smithi046 ceph-mon[28128]: pgmap v591: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:13:28.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:28 smithi073 ceph-mon[35473]: pgmap v591: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-10T23:13:28.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 253962 2.40 MB/sec execute 447 sec latency 14.258 ms 2024-09-10T23:13:29.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1461201 14.06 MB/sec execute 445 sec latency 623.279 ms 2024-09-10T23:13:29.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 254317 2.39 MB/sec execute 448 sec latency 213.747 ms 2024-09-10T23:13:30.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1461201 14.02 MB/sec execute 446 sec latency 1221.373 ms 2024-09-10T23:13:30.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:30 smithi046 ceph-mon[28128]: pgmap v592: 129 pgs: 129 active+clean; 130 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:13:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:30 smithi073 ceph-mon[35473]: pgmap v592: 129 pgs: 129 active+clean; 130 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:13:30.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 254656 2.40 MB/sec execute 449 sec latency 427.779 ms 2024-09-10T23:13:31.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1461696 14.00 MB/sec execute 447 sec latency 1300.095 ms 2024-09-10T23:13:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:31.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:31.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 255168 2.40 MB/sec execute 450 sec latency 293.738 ms 2024-09-10T23:13:32.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1464434 14.00 MB/sec execute 448 sec latency 1392.199 ms 2024-09-10T23:13:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:32 smithi046 ceph-mon[28128]: pgmap v593: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:13:32.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:32 smithi073 ceph-mon[35473]: pgmap v593: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-09-10T23:13:32.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 255538 2.40 MB/sec execute 451 sec latency 22.057 ms 2024-09-10T23:13:33.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1466677 14.00 MB/sec execute 449 sec latency 56.536 ms 2024-09-10T23:13:33.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 255859 2.40 MB/sec execute 452 sec latency 15.887 ms 2024-09-10T23:13:34.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1468941 13.99 MB/sec execute 450 sec latency 52.767 ms 2024-09-10T23:13:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:34 smithi046 ceph-mon[28128]: pgmap v594: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 926 KiB/s wr, 54 op/s 2024-09-10T23:13:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:34 smithi073 ceph-mon[35473]: pgmap v594: 129 pgs: 129 active+clean; 129 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 926 KiB/s wr, 54 op/s 2024-09-10T23:13:34.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 256254 2.40 MB/sec execute 453 sec latency 17.125 ms 2024-09-10T23:13:35.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1471772 14.00 MB/sec execute 451 sec latency 50.283 ms 2024-09-10T23:13:35.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 256708 2.39 MB/sec execute 454 sec latency 20.330 ms 2024-09-10T23:13:36.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1475194 14.01 MB/sec execute 452 sec latency 52.039 ms 2024-09-10T23:13:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:36 smithi046 ceph-mon[28128]: pgmap v595: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 58 op/s 2024-09-10T23:13:36.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:36 smithi073 ceph-mon[35473]: pgmap v595: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 58 op/s 2024-09-10T23:13:36.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 257247 2.40 MB/sec execute 455 sec latency 19.238 ms 2024-09-10T23:13:37.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1476033 13.99 MB/sec execute 453 sec latency 518.393 ms 2024-09-10T23:13:37.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 257750 2.39 MB/sec execute 456 sec latency 15.868 ms 2024-09-10T23:13:38.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1478747 13.99 MB/sec execute 454 sec latency 708.651 ms 2024-09-10T23:13:38.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:38 smithi046 ceph-mon[28128]: pgmap v596: 129 pgs: 129 active+clean; 133 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-09-10T23:13:38.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:38 smithi073 ceph-mon[35473]: pgmap v596: 129 pgs: 129 active+clean; 133 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-09-10T23:13:38.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 258294 2.40 MB/sec execute 457 sec latency 18.778 ms 2024-09-10T23:13:39.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1482166 14.00 MB/sec execute 455 sec latency 116.856 ms 2024-09-10T23:13:39.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 258745 2.40 MB/sec execute 458 sec latency 18.988 ms 2024-09-10T23:13:40.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1484679 14.00 MB/sec execute 456 sec latency 67.707 ms 2024-09-10T23:13:40.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:40 smithi046 ceph-mon[28128]: pgmap v597: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 935 KiB/s wr, 55 op/s 2024-09-10T23:13:40.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:40 smithi073 ceph-mon[35473]: pgmap v597: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 935 KiB/s wr, 55 op/s 2024-09-10T23:13:40.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 259222 2.40 MB/sec execute 459 sec latency 16.777 ms 2024-09-10T23:13:41.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1487378 13.99 MB/sec execute 457 sec latency 41.843 ms 2024-09-10T23:13:41.889 INFO:tasks.workunit.client.1.smithi073.stdout: 1 259503 2.40 MB/sec execute 460 sec latency 17.587 ms 2024-09-10T23:13:42.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1489657 13.99 MB/sec execute 458 sec latency 69.900 ms 2024-09-10T23:13:42.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:42 smithi046 ceph-mon[28128]: pgmap v598: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:13:42.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:42 smithi073 ceph-mon[35473]: pgmap v598: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 77 op/s 2024-09-10T23:13:42.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 259950 2.40 MB/sec execute 461 sec latency 22.343 ms 2024-09-10T23:13:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1493008 14.00 MB/sec execute 459 sec latency 58.344 ms 2024-09-10T23:13:43.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 260442 2.40 MB/sec execute 462 sec latency 18.772 ms 2024-09-10T23:13:44.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1496407 14.01 MB/sec execute 460 sec latency 57.819 ms 2024-09-10T23:13:44.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:44 smithi046 ceph-mon[28128]: pgmap v599: 129 pgs: 129 active+clean; 133 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:13:44.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:44 smithi073 ceph-mon[35473]: pgmap v599: 129 pgs: 129 active+clean; 133 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:13:44.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 260940 2.40 MB/sec execute 463 sec latency 16.705 ms 2024-09-10T23:13:45.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1499898 14.02 MB/sec execute 461 sec latency 45.899 ms 2024-09-10T23:13:45.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 261394 2.39 MB/sec execute 464 sec latency 18.883 ms 2024-09-10T23:13:46.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1502511 14.02 MB/sec execute 462 sec latency 50.042 ms 2024-09-10T23:13:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:46 smithi046 ceph-mon[28128]: pgmap v600: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:13:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:46.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:46 smithi073 ceph-mon[35473]: pgmap v600: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:13:46.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:13:46.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 261984 2.40 MB/sec execute 465 sec latency 16.748 ms 2024-09-10T23:13:47.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1504653 14.01 MB/sec execute 463 sec latency 65.866 ms 2024-09-10T23:13:47.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 262360 2.40 MB/sec execute 466 sec latency 18.022 ms 2024-09-10T23:13:48.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1507298 14.02 MB/sec execute 464 sec latency 58.427 ms 2024-09-10T23:13:48.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:48 smithi046 ceph-mon[28128]: pgmap v601: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:13:48.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:48 smithi073 ceph-mon[35473]: pgmap v601: 129 pgs: 129 active+clean; 132 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:13:48.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 262838 2.40 MB/sec execute 467 sec latency 19.376 ms 2024-09-10T23:13:49.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1510662 14.03 MB/sec execute 465 sec latency 58.476 ms 2024-09-10T23:13:49.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 263139 2.40 MB/sec execute 468 sec latency 24.586 ms 2024-09-10T23:13:50.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1514139 14.04 MB/sec execute 466 sec latency 49.845 ms 2024-09-10T23:13:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:50 smithi046 ceph-mon[28128]: pgmap v602: 129 pgs: 129 active+clean; 133 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1011 KiB/s wr, 58 op/s 2024-09-10T23:13:50.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:50 smithi073 ceph-mon[35473]: pgmap v602: 129 pgs: 129 active+clean; 133 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.6 KiB/s rd, 1011 KiB/s wr, 58 op/s 2024-09-10T23:13:50.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 263620 2.40 MB/sec execute 469 sec latency 19.597 ms 2024-09-10T23:13:51.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1517619 14.05 MB/sec execute 467 sec latency 50.271 ms 2024-09-10T23:13:51.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 264107 2.40 MB/sec execute 470 sec latency 22.544 ms 2024-09-10T23:13:52.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1519921 14.04 MB/sec execute 468 sec latency 58.538 ms 2024-09-10T23:13:52.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:52 smithi046 ceph-mon[28128]: pgmap v603: 129 pgs: 129 active+clean; 136 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 MiB/s wr, 77 op/s 2024-09-10T23:13:52.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:52 smithi073 ceph-mon[35473]: pgmap v603: 129 pgs: 129 active+clean; 136 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.4 MiB/s wr, 77 op/s 2024-09-10T23:13:52.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 264595 2.40 MB/sec execute 471 sec latency 21.498 ms 2024-09-10T23:13:53.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1522129 14.04 MB/sec execute 469 sec latency 96.733 ms 2024-09-10T23:13:53.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 265061 2.40 MB/sec execute 472 sec latency 17.974 ms 2024-09-10T23:13:54.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1524956 14.04 MB/sec execute 470 sec latency 58.276 ms 2024-09-10T23:13:54.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:54 smithi046 ceph-mon[28128]: pgmap v604: 129 pgs: 129 active+clean; 136 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:13:54.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:54 smithi073 ceph-mon[35473]: pgmap v604: 129 pgs: 129 active+clean; 136 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-10T23:13:54.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 265790 2.40 MB/sec execute 473 sec latency 17.704 ms 2024-09-10T23:13:55.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1528327 14.05 MB/sec execute 471 sec latency 50.571 ms 2024-09-10T23:13:55.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 266083 2.41 MB/sec execute 474 sec latency 21.777 ms 2024-09-10T23:13:56.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1531813 14.06 MB/sec execute 472 sec latency 51.910 ms 2024-09-10T23:13:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:56 smithi046 ceph-mon[28128]: pgmap v605: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:13:56.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:56 smithi073 ceph-mon[35473]: pgmap v605: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.0 MiB/s wr, 62 op/s 2024-09-10T23:13:56.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 266439 2.40 MB/sec execute 475 sec latency 18.431 ms 2024-09-10T23:13:57.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1534044 14.06 MB/sec execute 473 sec latency 186.603 ms 2024-09-10T23:13:57.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 266782 2.40 MB/sec execute 476 sec latency 18.550 ms 2024-09-10T23:13:58.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1535355 14.04 MB/sec execute 474 sec latency 340.589 ms 2024-09-10T23:13:58.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:13:58 smithi073 ceph-mon[35473]: pgmap v606: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:13:58.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 267245 2.40 MB/sec execute 477 sec latency 18.537 ms 2024-09-10T23:13:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:13:58 smithi046 ceph-mon[28128]: pgmap v606: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:13:59.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1536159 14.02 MB/sec execute 475 sec latency 748.454 ms 2024-09-10T23:13:59.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 267757 2.40 MB/sec execute 478 sec latency 21.339 ms 2024-09-10T23:14:00.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1539028 14.02 MB/sec execute 476 sec latency 41.621 ms 2024-09-10T23:14:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:00 smithi073 ceph-mon[35473]: pgmap v607: 129 pgs: 129 active+clean; 136 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:14:00.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 268253 2.40 MB/sec execute 479 sec latency 15.724 ms 2024-09-10T23:14:01.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:00 smithi046 ceph-mon[28128]: pgmap v607: 129 pgs: 129 active+clean; 136 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2024-09-10T23:14:01.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1542502 14.03 MB/sec execute 477 sec latency 58.592 ms 2024-09-10T23:14:01.890 INFO:tasks.workunit.client.1.smithi073.stdout: 1 268664 2.40 MB/sec execute 480 sec latency 78.106 ms 2024-09-10T23:14:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:02.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1545983 14.04 MB/sec execute 478 sec latency 50.080 ms 2024-09-10T23:14:02.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 269363 2.40 MB/sec execute 481 sec latency 15.833 ms 2024-09-10T23:14:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:02 smithi046 ceph-mon[28128]: pgmap v608: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 66 op/s 2024-09-10T23:14:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:02 smithi073 ceph-mon[35473]: pgmap v608: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 66 op/s 2024-09-10T23:14:03.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1548073 14.04 MB/sec execute 479 sec latency 55.154 ms 2024-09-10T23:14:03.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 269677 2.41 MB/sec execute 482 sec latency 196.346 ms 2024-09-10T23:14:04.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1549592 14.03 MB/sec execute 480 sec latency 488.133 ms 2024-09-10T23:14:04.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 269966 2.40 MB/sec execute 483 sec latency 376.059 ms 2024-09-10T23:14:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:04 smithi046 ceph-mon[28128]: pgmap v609: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 963 KiB/s wr, 58 op/s 2024-09-10T23:14:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:04 smithi073 ceph-mon[35473]: pgmap v609: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 963 KiB/s wr, 58 op/s 2024-09-10T23:14:05.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1553074 14.04 MB/sec execute 481 sec latency 57.324 ms 2024-09-10T23:14:05.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 270286 2.40 MB/sec execute 484 sec latency 18.570 ms 2024-09-10T23:14:06.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1554876 14.02 MB/sec execute 482 sec latency 54.858 ms 2024-09-10T23:14:06.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 270757 2.40 MB/sec execute 485 sec latency 18.274 ms 2024-09-10T23:14:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:06 smithi046 ceph-mon[28128]: pgmap v610: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-09-10T23:14:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:06 smithi073 ceph-mon[35473]: pgmap v610: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-09-10T23:14:07.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1556937 14.02 MB/sec execute 483 sec latency 50.162 ms 2024-09-10T23:14:07.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 271227 2.40 MB/sec execute 486 sec latency 20.252 ms 2024-09-10T23:14:08.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1560293 14.03 MB/sec execute 484 sec latency 53.201 ms 2024-09-10T23:14:08.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 271746 2.40 MB/sec execute 487 sec latency 20.636 ms 2024-09-10T23:14:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:08 smithi046 ceph-mon[28128]: pgmap v611: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:14:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:08 smithi073 ceph-mon[35473]: pgmap v611: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:14:09.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1560300 14.00 MB/sec execute 485 sec latency 844.584 ms 2024-09-10T23:14:09.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 272178 2.40 MB/sec execute 488 sec latency 18.608 ms 2024-09-10T23:14:10.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1560300 13.97 MB/sec execute 486 sec latency 1844.623 ms 2024-09-10T23:14:10.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 272593 2.40 MB/sec execute 489 sec latency 378.968 ms 2024-09-10T23:14:10.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:10 smithi073 ceph-mon[35473]: pgmap v612: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:14:10.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:10.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:14:10.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:14:10.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:10 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:14:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:10 smithi046 ceph-mon[28128]: pgmap v612: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:14:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:14:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:14:11.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:10 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:14:11.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1560371 13.94 MB/sec execute 487 sec latency 2066.843 ms 2024-09-10T23:14:11.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 272912 2.40 MB/sec execute 490 sec latency 385.644 ms 2024-09-10T23:14:12.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1563782 13.95 MB/sec execute 488 sec latency 818.029 ms 2024-09-10T23:14:12.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 273364 2.40 MB/sec execute 491 sec latency 16.359 ms 2024-09-10T23:14:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:12 smithi046 ceph-mon[28128]: pgmap v613: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-10T23:14:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:12 smithi073 ceph-mon[35473]: pgmap v613: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-10T23:14:13.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1567257 13.96 MB/sec execute 489 sec latency 83.454 ms 2024-09-10T23:14:13.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 273631 2.40 MB/sec execute 492 sec latency 15.295 ms 2024-09-10T23:14:14.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1569875 13.96 MB/sec execute 490 sec latency 47.822 ms 2024-09-10T23:14:14.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 274065 2.40 MB/sec execute 493 sec latency 17.760 ms 2024-09-10T23:14:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:14 smithi046 ceph-mon[28128]: pgmap v614: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:14:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:14 smithi073 ceph-mon[35473]: pgmap v614: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:14:15.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1572022 13.95 MB/sec execute 491 sec latency 65.624 ms 2024-09-10T23:14:15.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 274555 2.40 MB/sec execute 494 sec latency 19.178 ms 2024-09-10T23:14:16.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1574480 13.96 MB/sec execute 492 sec latency 237.951 ms 2024-09-10T23:14:16.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 275022 2.40 MB/sec execute 495 sec latency 17.532 ms 2024-09-10T23:14:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:16 smithi046 ceph-mon[28128]: pgmap v615: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:14:17.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:16 smithi073 ceph-mon[35473]: pgmap v615: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 MiB/s wr, 56 op/s 2024-09-10T23:14:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:17.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1576121 13.94 MB/sec execute 493 sec latency 425.258 ms 2024-09-10T23:14:17.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 275511 2.39 MB/sec execute 496 sec latency 21.746 ms 2024-09-10T23:14:18.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1578858 13.95 MB/sec execute 494 sec latency 75.065 ms 2024-09-10T23:14:18.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 276066 2.40 MB/sec execute 497 sec latency 19.068 ms 2024-09-10T23:14:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:18 smithi046 ceph-mon[28128]: pgmap v616: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:14:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:18 smithi073 ceph-mon[35473]: pgmap v616: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:14:19.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1581645 13.95 MB/sec execute 495 sec latency 57.760 ms 2024-09-10T23:14:19.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 276480 2.40 MB/sec execute 498 sec latency 15.896 ms 2024-09-10T23:14:20.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1585116 13.96 MB/sec execute 496 sec latency 42.128 ms 2024-09-10T23:14:20.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 276965 2.40 MB/sec execute 499 sec latency 15.202 ms 2024-09-10T23:14:20.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:20 smithi073 ceph-mon[35473]: pgmap v617: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 930 KiB/s wr, 54 op/s 2024-09-10T23:14:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:20 smithi046 ceph-mon[28128]: pgmap v617: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 930 KiB/s wr, 54 op/s 2024-09-10T23:14:21.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1588583 13.97 MB/sec execute 497 sec latency 50.427 ms 2024-09-10T23:14:21.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 277225 2.40 MB/sec execute 500 sec latency 18.546 ms 2024-09-10T23:14:22.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1588840 13.94 MB/sec execute 498 sec latency 601.750 ms 2024-09-10T23:14:22.891 INFO:tasks.workunit.client.1.smithi073.stdout: 1 277496 2.40 MB/sec execute 501 sec latency 388.741 ms 2024-09-10T23:14:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:22 smithi046 ceph-mon[28128]: pgmap v618: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-10T23:14:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:22 smithi073 ceph-mon[35473]: pgmap v618: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-10T23:14:23.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1592196 13.95 MB/sec execute 499 sec latency 657.784 ms 2024-09-10T23:14:23.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 277925 2.39 MB/sec execute 502 sec latency 18.274 ms 2024-09-10T23:14:24.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1595681 13.96 MB/sec execute 500 sec latency 49.658 ms 2024-09-10T23:14:24.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 278463 2.40 MB/sec execute 503 sec latency 23.514 ms 2024-09-10T23:14:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:24 smithi046 ceph-mon[28128]: pgmap v619: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:14:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:24 smithi073 ceph-mon[35473]: pgmap v619: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:14:25.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1598191 13.96 MB/sec execute 501 sec latency 87.980 ms 2024-09-10T23:14:25.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 278954 2.39 MB/sec execute 504 sec latency 19.092 ms 2024-09-10T23:14:26.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1600963 13.96 MB/sec execute 502 sec latency 57.622 ms 2024-09-10T23:14:26.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 279452 2.40 MB/sec execute 505 sec latency 18.231 ms 2024-09-10T23:14:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:26 smithi046 ceph-mon[28128]: pgmap v620: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:14:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:26 smithi073 ceph-mon[35473]: pgmap v620: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:14:27.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1603726 13.96 MB/sec execute 503 sec latency 49.071 ms 2024-09-10T23:14:27.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 280005 2.40 MB/sec execute 506 sec latency 17.819 ms 2024-09-10T23:14:28.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1606446 13.96 MB/sec execute 504 sec latency 66.863 ms 2024-09-10T23:14:28.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 280462 2.40 MB/sec execute 507 sec latency 15.047 ms 2024-09-10T23:14:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:28 smithi046 ceph-mon[28128]: pgmap v621: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:14:29.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:28 smithi073 ceph-mon[35473]: pgmap v621: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2024-09-10T23:14:29.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1609914 13.97 MB/sec execute 505 sec latency 46.923 ms 2024-09-10T23:14:29.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 280717 2.40 MB/sec execute 508 sec latency 14.335 ms 2024-09-10T23:14:30.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1612516 13.97 MB/sec execute 506 sec latency 74.988 ms 2024-09-10T23:14:30.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 281156 2.40 MB/sec execute 509 sec latency 17.044 ms 2024-09-10T23:14:30.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:30 smithi073 ceph-mon[35473]: pgmap v622: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 923 KiB/s wr, 51 op/s 2024-09-10T23:14:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:30 smithi046 ceph-mon[28128]: pgmap v622: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 923 KiB/s wr, 51 op/s 2024-09-10T23:14:31.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1615277 13.97 MB/sec execute 507 sec latency 58.053 ms 2024-09-10T23:14:31.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 281648 2.40 MB/sec execute 510 sec latency 19.659 ms 2024-09-10T23:14:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:32.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1618164 13.98 MB/sec execute 508 sec latency 50.082 ms 2024-09-10T23:14:32.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 282115 2.40 MB/sec execute 511 sec latency 15.452 ms 2024-09-10T23:14:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:32 smithi046 ceph-mon[28128]: pgmap v623: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 70 op/s 2024-09-10T23:14:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:32 smithi073 ceph-mon[35473]: pgmap v623: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 70 op/s 2024-09-10T23:14:33.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1620742 13.98 MB/sec execute 509 sec latency 49.165 ms 2024-09-10T23:14:33.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 282611 2.39 MB/sec execute 512 sec latency 19.132 ms 2024-09-10T23:14:34.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1624169 13.99 MB/sec execute 510 sec latency 53.826 ms 2024-09-10T23:14:34.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:34 smithi046 ceph-mon[28128]: pgmap v624: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1016 KiB/s wr, 53 op/s 2024-09-10T23:14:34.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 283182 2.40 MB/sec execute 513 sec latency 18.364 ms 2024-09-10T23:14:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:34 smithi073 ceph-mon[35473]: pgmap v624: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1016 KiB/s wr, 53 op/s 2024-09-10T23:14:35.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1627651 14.00 MB/sec execute 511 sec latency 48.091 ms 2024-09-10T23:14:35.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 283573 2.40 MB/sec execute 514 sec latency 17.402 ms 2024-09-10T23:14:36.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1631138 14.01 MB/sec execute 512 sec latency 65.745 ms 2024-09-10T23:14:36.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 284056 2.40 MB/sec execute 515 sec latency 19.402 ms 2024-09-10T23:14:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:36 smithi046 ceph-mon[28128]: pgmap v625: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:14:37.110 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:36 smithi073 ceph-mon[35473]: pgmap v625: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-10T23:14:37.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1633790 14.01 MB/sec execute 513 sec latency 47.797 ms 2024-09-10T23:14:37.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 284339 2.40 MB/sec execute 516 sec latency 17.932 ms 2024-09-10T23:14:38.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1636921 14.01 MB/sec execute 514 sec latency 51.291 ms 2024-09-10T23:14:38.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 284774 2.40 MB/sec execute 517 sec latency 18.456 ms 2024-09-10T23:14:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:38 smithi046 ceph-mon[28128]: pgmap v626: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:14:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:38 smithi073 ceph-mon[35473]: pgmap v626: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:14:39.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1639439 14.01 MB/sec execute 515 sec latency 45.795 ms 2024-09-10T23:14:39.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 285276 2.40 MB/sec execute 518 sec latency 21.279 ms 2024-09-10T23:14:40.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1641979 14.01 MB/sec execute 516 sec latency 116.840 ms 2024-09-10T23:14:40.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 285759 2.40 MB/sec execute 519 sec latency 18.782 ms 2024-09-10T23:14:40.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:40 smithi073 ceph-mon[35473]: pgmap v627: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:14:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:40 smithi046 ceph-mon[28128]: pgmap v627: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:14:41.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1645435 14.02 MB/sec execute 517 sec latency 41.903 ms 2024-09-10T23:14:41.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 286215 2.39 MB/sec execute 520 sec latency 20.582 ms 2024-09-10T23:14:42.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1648862 14.03 MB/sec execute 518 sec latency 134.595 ms 2024-09-10T23:14:42.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 286769 2.40 MB/sec execute 521 sec latency 78.082 ms 2024-09-10T23:14:43.038 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:42 smithi073 ceph-mon[35473]: pgmap v628: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:14:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:42 smithi046 ceph-mon[28128]: pgmap v628: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2024-09-10T23:14:43.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1649107 14.00 MB/sec execute 519 sec latency 458.638 ms 2024-09-10T23:14:43.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 287093 2.40 MB/sec execute 522 sec latency 347.717 ms 2024-09-10T23:14:44.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1652470 14.01 MB/sec execute 520 sec latency 166.053 ms 2024-09-10T23:14:44.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 287408 2.40 MB/sec execute 523 sec latency 243.118 ms 2024-09-10T23:14:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:44 smithi046 ceph-mon[28128]: pgmap v629: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 996 KiB/s wr, 57 op/s 2024-09-10T23:14:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:44 smithi073 ceph-mon[35473]: pgmap v629: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 996 KiB/s wr, 57 op/s 2024-09-10T23:14:45.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1655956 14.02 MB/sec execute 521 sec latency 61.362 ms 2024-09-10T23:14:45.892 INFO:tasks.workunit.client.1.smithi073.stdout: 1 287742 2.40 MB/sec execute 524 sec latency 14.829 ms 2024-09-10T23:14:46.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1658271 14.02 MB/sec execute 522 sec latency 104.765 ms 2024-09-10T23:14:46.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 288090 2.39 MB/sec execute 525 sec latency 21.254 ms 2024-09-10T23:14:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:46 smithi046 ceph-mon[28128]: pgmap v630: 129 pgs: 129 active+clean; 144 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:14:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:46 smithi073 ceph-mon[35473]: pgmap v630: 129 pgs: 129 active+clean; 144 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:14:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:14:47.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1660712 14.02 MB/sec execute 523 sec latency 50.067 ms 2024-09-10T23:14:47.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 288536 2.39 MB/sec execute 526 sec latency 18.187 ms 2024-09-10T23:14:48.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1663053 14.01 MB/sec execute 524 sec latency 266.881 ms 2024-09-10T23:14:48.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 289029 2.39 MB/sec execute 527 sec latency 18.769 ms 2024-09-10T23:14:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:48 smithi046 ceph-mon[28128]: pgmap v631: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:14:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:48 smithi073 ceph-mon[35473]: pgmap v631: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.2 MiB/s wr, 59 op/s 2024-09-10T23:14:49.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1665691 14.02 MB/sec execute 525 sec latency 66.098 ms 2024-09-10T23:14:49.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 289525 2.39 MB/sec execute 528 sec latency 17.314 ms 2024-09-10T23:14:50.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1668673 14.02 MB/sec execute 526 sec latency 48.415 ms 2024-09-10T23:14:50.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 289941 2.39 MB/sec execute 529 sec latency 19.087 ms 2024-09-10T23:14:50.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:50 smithi073 ceph-mon[35473]: pgmap v632: 129 pgs: 129 active+clean; 144 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 966 KiB/s wr, 53 op/s 2024-09-10T23:14:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:50 smithi046 ceph-mon[28128]: pgmap v632: 129 pgs: 129 active+clean; 144 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 966 KiB/s wr, 53 op/s 2024-09-10T23:14:51.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1671349 14.02 MB/sec execute 527 sec latency 49.698 ms 2024-09-10T23:14:51.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 290623 2.40 MB/sec execute 530 sec latency 20.586 ms 2024-09-10T23:14:52.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1673995 14.02 MB/sec execute 528 sec latency 53.078 ms 2024-09-10T23:14:52.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 290993 2.40 MB/sec execute 531 sec latency 18.579 ms 2024-09-10T23:14:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:52 smithi046 ceph-mon[28128]: pgmap v633: 129 pgs: 129 active+clean; 144 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:14:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:52 smithi073 ceph-mon[35473]: pgmap v633: 129 pgs: 129 active+clean; 144 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:14:53.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1677243 14.03 MB/sec execute 529 sec latency 241.802 ms 2024-09-10T23:14:53.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 291302 2.40 MB/sec execute 532 sec latency 18.475 ms 2024-09-10T23:14:54.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1677243 14.00 MB/sec execute 530 sec latency 1151.107 ms 2024-09-10T23:14:54.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 291665 2.39 MB/sec execute 533 sec latency 20.494 ms 2024-09-10T23:14:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:54 smithi046 ceph-mon[28128]: pgmap v634: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 953 KiB/s wr, 50 op/s 2024-09-10T23:14:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:54 smithi073 ceph-mon[35473]: pgmap v634: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 953 KiB/s wr, 50 op/s 2024-09-10T23:14:55.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1677243 13.97 MB/sec execute 531 sec latency 2151.153 ms 2024-09-10T23:14:55.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 292103 2.39 MB/sec execute 534 sec latency 17.386 ms 2024-09-10T23:14:56.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1677287 13.95 MB/sec execute 532 sec latency 3133.402 ms 2024-09-10T23:14:56.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 292612 2.39 MB/sec execute 535 sec latency 16.522 ms 2024-09-10T23:14:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:56 smithi046 ceph-mon[28128]: pgmap v635: 129 pgs: 129 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.0 MiB/s wr, 56 op/s 2024-09-10T23:14:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:56 smithi073 ceph-mon[35473]: pgmap v635: 129 pgs: 129 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.0 MiB/s wr, 56 op/s 2024-09-10T23:14:57.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1680776 13.96 MB/sec execute 533 sec latency 48.707 ms 2024-09-10T23:14:57.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 293141 2.39 MB/sec execute 536 sec latency 17.069 ms 2024-09-10T23:14:58.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1683291 13.96 MB/sec execute 534 sec latency 46.922 ms 2024-09-10T23:14:58.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 293619 2.40 MB/sec execute 537 sec latency 18.828 ms 2024-09-10T23:14:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:14:58 smithi046 ceph-mon[28128]: pgmap v636: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 66 op/s 2024-09-10T23:14:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:14:58 smithi073 ceph-mon[35473]: pgmap v636: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 MiB/s wr, 66 op/s 2024-09-10T23:14:59.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1686063 13.95 MB/sec execute 535 sec latency 91.253 ms 2024-09-10T23:14:59.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 294184 2.40 MB/sec execute 538 sec latency 17.336 ms 2024-09-10T23:15:00.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1689077 13.96 MB/sec execute 536 sec latency 46.921 ms 2024-09-10T23:15:00.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 294631 2.40 MB/sec execute 539 sec latency 19.253 ms 2024-09-10T23:15:00.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:00 smithi073 ceph-mon[35473]: pgmap v637: 129 pgs: 129 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 934 KiB/s wr, 56 op/s 2024-09-10T23:15:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:00 smithi046 ceph-mon[28128]: pgmap v637: 129 pgs: 129 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 934 KiB/s wr, 56 op/s 2024-09-10T23:15:01.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1691539 13.96 MB/sec execute 537 sec latency 160.372 ms 2024-09-10T23:15:01.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 294899 2.40 MB/sec execute 540 sec latency 15.266 ms 2024-09-10T23:15:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:02.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1692995 13.94 MB/sec execute 538 sec latency 589.175 ms 2024-09-10T23:15:02.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 295337 2.40 MB/sec execute 541 sec latency 22.210 ms 2024-09-10T23:15:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:02 smithi046 ceph-mon[28128]: pgmap v638: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2024-09-10T23:15:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:02 smithi073 ceph-mon[35473]: pgmap v638: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2024-09-10T23:15:03.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1695165 13.94 MB/sec execute 539 sec latency 89.399 ms 2024-09-10T23:15:03.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 295828 2.40 MB/sec execute 542 sec latency 19.426 ms 2024-09-10T23:15:04.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1698568 13.95 MB/sec execute 540 sec latency 83.467 ms 2024-09-10T23:15:04.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 296298 2.39 MB/sec execute 543 sec latency 17.061 ms 2024-09-10T23:15:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:04 smithi046 ceph-mon[28128]: pgmap v639: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-10T23:15:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:04 smithi073 ceph-mon[35473]: pgmap v639: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-10T23:15:05.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1702055 13.96 MB/sec execute 541 sec latency 57.909 ms 2024-09-10T23:15:05.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 296805 2.39 MB/sec execute 544 sec latency 18.382 ms 2024-09-10T23:15:06.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1704672 13.96 MB/sec execute 542 sec latency 57.668 ms 2024-09-10T23:15:06.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 297397 2.40 MB/sec execute 545 sec latency 17.409 ms 2024-09-10T23:15:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:06 smithi046 ceph-mon[28128]: pgmap v640: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.1 MiB/s wr, 60 op/s 2024-09-10T23:15:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:06 smithi073 ceph-mon[35473]: pgmap v640: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.1 MiB/s wr, 60 op/s 2024-09-10T23:15:07.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1705725 13.95 MB/sec execute 543 sec latency 408.523 ms 2024-09-10T23:15:07.893 INFO:tasks.workunit.client.1.smithi073.stdout: 1 297780 2.40 MB/sec execute 546 sec latency 19.040 ms 2024-09-10T23:15:08.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1708253 13.95 MB/sec execute 544 sec latency 400.167 ms 2024-09-10T23:15:08.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 298272 2.40 MB/sec execute 547 sec latency 17.619 ms 2024-09-10T23:15:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:08 smithi046 ceph-mon[28128]: pgmap v641: 129 pgs: 129 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:15:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:08 smithi073 ceph-mon[35473]: pgmap v641: 129 pgs: 129 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-09-10T23:15:09.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1711379 13.95 MB/sec execute 545 sec latency 50.037 ms 2024-09-10T23:15:09.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 298573 2.40 MB/sec execute 548 sec latency 15.673 ms 2024-09-10T23:15:10.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1713904 13.95 MB/sec execute 546 sec latency 47.147 ms 2024-09-10T23:15:10.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 299033 2.40 MB/sec execute 549 sec latency 18.087 ms 2024-09-10T23:15:10.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:10 smithi073 ceph-mon[35473]: pgmap v642: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:15:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:10 smithi046 ceph-mon[28128]: pgmap v642: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-09-10T23:15:11.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1716477 13.95 MB/sec execute 547 sec latency 54.482 ms 2024-09-10T23:15:11.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 299531 2.40 MB/sec execute 550 sec latency 25.281 ms 2024-09-10T23:15:12.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:12.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:15:12.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:11 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:15:12.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:12.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:15:12.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:11 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:15:12.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1719844 13.96 MB/sec execute 548 sec latency 141.813 ms 2024-09-10T23:15:12.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 300029 2.40 MB/sec execute 551 sec latency 17.025 ms 2024-09-10T23:15:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:12 smithi046 ceph-mon[28128]: pgmap v643: 129 pgs: 129 active+clean; 150 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:15:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:12 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:15:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:12 smithi073 ceph-mon[35473]: pgmap v643: 129 pgs: 129 active+clean; 150 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-10T23:15:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:12 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:15:13.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1719983 13.93 MB/sec execute 549 sec latency 646.742 ms 2024-09-10T23:15:13.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 300449 2.39 MB/sec execute 552 sec latency 20.625 ms 2024-09-10T23:15:14.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1723384 13.94 MB/sec execute 550 sec latency 83.024 ms 2024-09-10T23:15:14.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 301160 2.40 MB/sec execute 553 sec latency 20.105 ms 2024-09-10T23:15:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:14 smithi046 ceph-mon[28128]: pgmap v644: 129 pgs: 129 active+clean; 150 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:15:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:14 smithi073 ceph-mon[35473]: pgmap v644: 129 pgs: 129 active+clean; 150 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-10T23:15:15.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1726922 13.95 MB/sec execute 551 sec latency 49.495 ms 2024-09-10T23:15:15.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 301510 2.40 MB/sec execute 554 sec latency 17.486 ms 2024-09-10T23:15:16.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1729188 13.95 MB/sec execute 552 sec latency 122.334 ms 2024-09-10T23:15:16.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 301890 2.40 MB/sec execute 555 sec latency 19.259 ms 2024-09-10T23:15:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:16 smithi046 ceph-mon[28128]: pgmap v645: 129 pgs: 129 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:15:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:16 smithi073 ceph-mon[35473]: pgmap v645: 129 pgs: 129 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-09-10T23:15:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:17.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1732109 13.95 MB/sec execute 553 sec latency 49.193 ms 2024-09-10T23:15:17.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 302190 2.40 MB/sec execute 556 sec latency 20.349 ms 2024-09-10T23:15:18.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1734089 13.95 MB/sec execute 554 sec latency 208.505 ms 2024-09-10T23:15:18.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 302664 2.40 MB/sec execute 557 sec latency 20.458 ms 2024-09-10T23:15:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:18 smithi046 ceph-mon[28128]: pgmap v646: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:15:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:18 smithi073 ceph-mon[35473]: pgmap v646: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2024-09-10T23:15:19.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1735628 13.93 MB/sec execute 555 sec latency 670.495 ms 2024-09-10T23:15:19.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 303145 2.40 MB/sec execute 558 sec latency 22.503 ms 2024-09-10T23:15:20.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1737750 13.93 MB/sec execute 556 sec latency 80.303 ms 2024-09-10T23:15:20.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 303663 2.40 MB/sec execute 559 sec latency 18.549 ms 2024-09-10T23:15:20.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:20 smithi073 ceph-mon[35473]: pgmap v647: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:15:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:20 smithi046 ceph-mon[28128]: pgmap v647: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-10T23:15:21.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1741116 13.94 MB/sec execute 557 sec latency 53.651 ms 2024-09-10T23:15:21.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 304098 2.40 MB/sec execute 560 sec latency 19.760 ms 2024-09-10T23:15:22.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1744604 13.95 MB/sec execute 558 sec latency 46.080 ms 2024-09-10T23:15:22.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 304809 2.40 MB/sec execute 561 sec latency 20.978 ms 2024-09-10T23:15:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:22 smithi046 ceph-mon[28128]: pgmap v648: 129 pgs: 129 active+clean; 150 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-09-10T23:15:23.094 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:22 smithi073 ceph-mon[35473]: pgmap v648: 129 pgs: 129 active+clean; 150 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-09-10T23:15:23.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1747286 13.95 MB/sec execute 559 sec latency 49.490 ms 2024-09-10T23:15:23.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 305155 2.40 MB/sec execute 562 sec latency 20.089 ms 2024-09-10T23:15:24.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1748269 13.93 MB/sec execute 560 sec latency 608.527 ms 2024-09-10T23:15:24.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 305406 2.40 MB/sec execute 563 sec latency 308.288 ms 2024-09-10T23:15:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:24 smithi046 ceph-mon[28128]: pgmap v649: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1019 KiB/s wr, 57 op/s 2024-09-10T23:15:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:24 smithi073 ceph-mon[35473]: pgmap v649: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1019 KiB/s wr, 57 op/s 2024-09-10T23:15:25.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1751692 13.94 MB/sec execute 561 sec latency 141.887 ms 2024-09-10T23:15:25.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 305730 2.40 MB/sec execute 564 sec latency 17.694 ms 2024-09-10T23:15:26.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1754340 13.94 MB/sec execute 562 sec latency 54.791 ms 2024-09-10T23:15:26.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 306160 2.40 MB/sec execute 565 sec latency 107.046 ms 2024-09-10T23:15:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:26 smithi046 ceph-mon[28128]: pgmap v650: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:15:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:26 smithi073 ceph-mon[35473]: pgmap v650: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2024-09-10T23:15:27.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1756488 13.94 MB/sec execute 563 sec latency 132.013 ms 2024-09-10T23:15:27.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 306656 2.40 MB/sec execute 566 sec latency 16.880 ms 2024-09-10T23:15:28.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1759126 13.94 MB/sec execute 564 sec latency 53.534 ms 2024-09-10T23:15:28.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 307141 2.40 MB/sec execute 567 sec latency 20.660 ms 2024-09-10T23:15:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:28 smithi046 ceph-mon[28128]: pgmap v651: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2024-09-10T23:15:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:28 smithi073 ceph-mon[35473]: pgmap v651: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2024-09-10T23:15:29.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1762521 13.95 MB/sec execute 565 sec latency 50.112 ms 2024-09-10T23:15:29.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 307571 2.39 MB/sec execute 568 sec latency 20.178 ms 2024-09-10T23:15:30.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1763348 13.93 MB/sec execute 566 sec latency 565.661 ms 2024-09-10T23:15:30.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 308342 2.40 MB/sec execute 569 sec latency 19.328 ms 2024-09-10T23:15:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:30 smithi046 ceph-mon[28128]: pgmap v652: 129 pgs: 129 active+clean; 153 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-09-10T23:15:31.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:30 smithi073 ceph-mon[35473]: pgmap v652: 129 pgs: 129 active+clean; 153 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-09-10T23:15:31.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1766138 13.93 MB/sec execute 567 sec latency 41.728 ms 2024-09-10T23:15:31.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 308642 2.40 MB/sec execute 570 sec latency 17.016 ms 2024-09-10T23:15:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:32.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:32.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1769538 13.94 MB/sec execute 568 sec latency 91.481 ms 2024-09-10T23:15:32.894 INFO:tasks.workunit.client.1.smithi073.stdout: 1 309007 2.40 MB/sec execute 571 sec latency 14.927 ms 2024-09-10T23:15:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:32 smithi046 ceph-mon[28128]: pgmap v653: 129 pgs: 129 active+clean; 153 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:15:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:32 smithi073 ceph-mon[35473]: pgmap v653: 129 pgs: 129 active+clean; 153 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-09-10T23:15:33.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1773020 13.95 MB/sec execute 569 sec latency 46.863 ms 2024-09-10T23:15:33.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 309368 2.40 MB/sec execute 572 sec latency 21.624 ms 2024-09-10T23:15:34.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1775108 13.94 MB/sec execute 570 sec latency 66.865 ms 2024-09-10T23:15:34.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 309824 2.40 MB/sec execute 573 sec latency 23.055 ms 2024-09-10T23:15:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:34 smithi046 ceph-mon[28128]: pgmap v654: 129 pgs: 129 active+clean; 153 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 50 op/s 2024-09-10T23:15:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:34 smithi073 ceph-mon[35473]: pgmap v654: 129 pgs: 129 active+clean; 153 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 MiB/s wr, 50 op/s 2024-09-10T23:15:35.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1776696 13.93 MB/sec execute 571 sec latency 366.805 ms 2024-09-10T23:15:35.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 310272 2.40 MB/sec execute 574 sec latency 88.929 ms 2024-09-10T23:15:36.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1778369 13.92 MB/sec execute 572 sec latency 504.856 ms 2024-09-10T23:15:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:36 smithi046 ceph-mon[28128]: pgmap v655: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-09-10T23:15:36.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 310790 2.40 MB/sec execute 575 sec latency 17.637 ms 2024-09-10T23:15:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:36 smithi073 ceph-mon[35473]: pgmap v655: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-09-10T23:15:37.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1781072 13.93 MB/sec execute 573 sec latency 58.721 ms 2024-09-10T23:15:37.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 311213 2.40 MB/sec execute 576 sec latency 19.452 ms 2024-09-10T23:15:38.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1783904 13.93 MB/sec execute 574 sec latency 44.897 ms 2024-09-10T23:15:38.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 311909 2.40 MB/sec execute 577 sec latency 16.680 ms 2024-09-10T23:15:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:38 smithi046 ceph-mon[28128]: pgmap v656: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 58 op/s 2024-09-10T23:15:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:38 smithi073 ceph-mon[35473]: pgmap v656: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 MiB/s wr, 58 op/s 2024-09-10T23:15:39.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1787331 13.94 MB/sec execute 575 sec latency 63.538 ms 2024-09-10T23:15:39.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 312305 2.40 MB/sec execute 578 sec latency 16.238 ms 2024-09-10T23:15:40.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1790810 13.94 MB/sec execute 576 sec latency 56.029 ms 2024-09-10T23:15:40.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 312609 2.40 MB/sec execute 579 sec latency 16.752 ms 2024-09-10T23:15:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:40 smithi046 ceph-mon[28128]: pgmap v657: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-10T23:15:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:40 smithi073 ceph-mon[35473]: pgmap v657: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-10T23:15:41.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1790956 13.92 MB/sec execute 577 sec latency 639.966 ms 2024-09-10T23:15:41.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 312823 2.40 MB/sec execute 580 sec latency 343.493 ms 2024-09-10T23:15:42.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1794353 13.93 MB/sec execute 578 sec latency 705.409 ms 2024-09-10T23:15:42.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 313281 2.40 MB/sec execute 581 sec latency 19.744 ms 2024-09-10T23:15:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:42 smithi046 ceph-mon[28128]: pgmap v658: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:15:43.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:42 smithi073 ceph-mon[35473]: pgmap v658: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:15:43.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1797847 13.94 MB/sec execute 579 sec latency 50.176 ms 2024-09-10T23:15:43.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 313773 2.40 MB/sec execute 582 sec latency 21.435 ms 2024-09-10T23:15:44.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1800465 13.94 MB/sec execute 580 sec latency 50.083 ms 2024-09-10T23:15:44.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 314254 2.40 MB/sec execute 583 sec latency 21.396 ms 2024-09-10T23:15:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:44 smithi046 ceph-mon[28128]: pgmap v659: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:15:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:44 smithi073 ceph-mon[35473]: pgmap v659: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-09-10T23:15:45.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1803185 13.94 MB/sec execute 581 sec latency 54.697 ms 2024-09-10T23:15:45.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 314715 2.39 MB/sec execute 584 sec latency 17.146 ms 2024-09-10T23:15:46.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1805247 13.93 MB/sec execute 582 sec latency 122.437 ms 2024-09-10T23:15:46.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 315320 2.40 MB/sec execute 585 sec latency 256.957 ms 2024-09-10T23:15:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:46 smithi046 ceph-mon[28128]: pgmap v660: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:15:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:46 smithi073 ceph-mon[35473]: pgmap v660: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-09-10T23:15:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:15:47.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1806671 13.92 MB/sec execute 583 sec latency 706.344 ms 2024-09-10T23:15:47.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 315518 2.40 MB/sec execute 586 sec latency 377.980 ms 2024-09-10T23:15:48.702 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1808724 13.92 MB/sec execute 584 sec latency 58.170 ms 2024-09-10T23:15:48.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 316008 2.40 MB/sec execute 587 sec latency 18.236 ms 2024-09-10T23:15:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:48 smithi046 ceph-mon[28128]: pgmap v661: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 MiB/s wr, 63 op/s 2024-09-10T23:15:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:48 smithi073 ceph-mon[35473]: pgmap v661: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 MiB/s wr, 63 op/s 2024-09-10T23:15:49.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1812147 13.93 MB/sec execute 585 sec latency 66.578 ms 2024-09-10T23:15:49.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 316307 2.40 MB/sec execute 588 sec latency 17.504 ms 2024-09-10T23:15:50.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1815620 13.94 MB/sec execute 586 sec latency 49.897 ms 2024-09-10T23:15:50.895 INFO:tasks.workunit.client.1.smithi073.stdout: 1 316763 2.40 MB/sec execute 589 sec latency 18.005 ms 2024-09-10T23:15:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:50 smithi046 ceph-mon[28128]: pgmap v662: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-09-10T23:15:51.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:50 smithi073 ceph-mon[35473]: pgmap v662: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-09-10T23:15:51.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1818982 13.94 MB/sec execute 587 sec latency 60.689 ms 2024-09-10T23:15:51.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 317266 2.40 MB/sec execute 590 sec latency 20.687 ms 2024-09-10T23:15:52.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1819323 13.92 MB/sec execute 588 sec latency 282.199 ms 2024-09-10T23:15:52.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 317759 2.39 MB/sec execute 591 sec latency 17.980 ms 2024-09-10T23:15:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:52 smithi046 ceph-mon[28128]: pgmap v663: 129 pgs: 129 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:15:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:52 smithi073 ceph-mon[35473]: pgmap v663: 129 pgs: 129 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 61 op/s 2024-09-10T23:15:53.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1822664 13.93 MB/sec execute 589 sec latency 541.932 ms 2024-09-10T23:15:53.898 INFO:tasks.workunit.client.1.smithi073.stdout: 1 318172 2.39 MB/sec execute 592 sec latency 23.772 ms 2024-09-10T23:15:54.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1825315 13.93 MB/sec execute 590 sec latency 58.408 ms 2024-09-10T23:15:54.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 318877 2.40 MB/sec execute 593 sec latency 19.022 ms 2024-09-10T23:15:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:54 smithi046 ceph-mon[28128]: pgmap v664: 129 pgs: 129 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1014 KiB/s wr, 55 op/s 2024-09-10T23:15:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:54 smithi073 ceph-mon[35473]: pgmap v664: 129 pgs: 129 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1014 KiB/s wr, 55 op/s 2024-09-10T23:15:55.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1828293 13.93 MB/sec execute 591 sec latency 43.513 ms 2024-09-10T23:15:55.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 319228 2.40 MB/sec execute 594 sec latency 19.195 ms 2024-09-10T23:15:56.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1829996 13.92 MB/sec execute 592 sec latency 75.154 ms 2024-09-10T23:15:56.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 319611 2.40 MB/sec execute 595 sec latency 16.884 ms 2024-09-10T23:15:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:56 smithi046 ceph-mon[28128]: pgmap v665: 129 pgs: 129 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 948 KiB/s wr, 62 op/s 2024-09-10T23:15:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:56 smithi073 ceph-mon[35473]: pgmap v665: 129 pgs: 129 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.4 KiB/s rd, 948 KiB/s wr, 62 op/s 2024-09-10T23:15:57.690 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1834052 13.97 MB/sec execute 593 sec latency 53.215 ms 2024-09-10T23:15:57.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 319937 2.40 MB/sec execute 596 sec latency 17.836 ms 2024-09-10T23:15:58.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1834109 13.94 MB/sec execute 594 sec latency 643.905 ms 2024-09-10T23:15:58.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 320401 2.40 MB/sec execute 597 sec latency 19.681 ms 2024-09-10T23:15:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:15:58 smithi046 ceph-mon[28128]: pgmap v666: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-09-10T23:15:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:15:58 smithi073 ceph-mon[35473]: pgmap v666: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-09-10T23:15:59.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1837617 13.95 MB/sec execute 595 sec latency 60.442 ms 2024-09-10T23:15:59.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 320877 2.40 MB/sec execute 598 sec latency 16.759 ms 2024-09-10T23:16:00.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1840128 13.95 MB/sec execute 596 sec latency 46.340 ms 2024-09-10T23:16:00.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 321387 2.39 MB/sec execute 599 sec latency 20.802 ms 2024-09-10T23:16:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:00 smithi046 ceph-mon[28128]: pgmap v667: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:16:01.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:00 smithi073 ceph-mon[35473]: pgmap v667: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-09-10T23:16:01.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1842896 13.95 MB/sec execute 597 sec latency 50.218 ms 2024-09-10T23:16:01.896 INFO:tasks.workunit.client.1.smithi073.stdout: 1 cleanup 600 sec 2024-09-10T23:16:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:02.303 INFO:tasks.workunit.client.1.smithi073.stdout: 0 cleanup 600 sec 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Operation Count AvgLat MaxLat 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: ---------------------------------------- 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: NTCreateX 46161 4.040 425.540 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Close 33915 0.067 1.664 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Rename 1954 10.421 371.232 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Unlink 9316 4.006 398.142 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Qpathinfo 41903 2.246 371.948 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Qfileinfo 7306 0.149 0.843 2024-09-10T23:16:02.304 INFO:tasks.workunit.client.1.smithi073.stdout: Qfsinfo 7660 0.833 2785.264 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: Sfileinfo 3764 1.163 3.150 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: Find 16179 14.203 427.772 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: WriteX 22815 0.268 1.990 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: ReadX 72355 0.006 0.416 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: LockX 150 0.839 1.305 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: UnlockX 150 0.736 1.262 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: Flush 3232 3.086 286.530 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout: 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stdout:Throughput 2.39498 MB/sec 1 clients 1 procs max_latency=2785.281 ms 2024-09-10T23:16:02.305 INFO:tasks.workunit.client.1.smithi073.stderr:+ dbench 10 2024-09-10T23:16:02.306 INFO:tasks.workunit.client.1.smithi073.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-10T23:16:02.306 INFO:tasks.workunit.client.1.smithi073.stdout: 2024-09-10T23:16:02.306 INFO:tasks.workunit.client.1.smithi073.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-10T23:16:02.308 INFO:tasks.workunit.client.1.smithi073.stdout:8 of 10 processes prepared for launch 0 sec 2024-09-10T23:16:02.408 INFO:tasks.workunit.client.1.smithi073.stdout:10 of 10 processes prepared for launch 0 sec 2024-09-10T23:16:02.408 INFO:tasks.workunit.client.1.smithi073.stdout:releasing clients 2024-09-10T23:16:02.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1845513 13.95 MB/sec execute 598 sec latency 57.558 ms 2024-09-10T23:16:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:02 smithi046 ceph-mon[28128]: pgmap v668: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:16:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:02 smithi073 ceph-mon[35473]: pgmap v668: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-10T23:16:03.408 INFO:tasks.workunit.client.1.smithi073.stdout: 10 242 92.27 MB/sec warmup 1 sec latency 37.809 ms 2024-09-10T23:16:03.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1848309 13.96 MB/sec execute 599 sec latency 156.206 ms 2024-09-10T23:16:04.408 INFO:tasks.workunit.client.1.smithi073.stdout: 10 432 76.20 MB/sec warmup 2 sec latency 158.802 ms 2024-09-10T23:16:04.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 600 sec 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 600 sec 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 265769 0.025 1.030 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: Close 195230 0.003 0.131 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 11252 0.061 1.132 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 53686 0.058 73.967 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: Deltree 8 6.325 13.771 2024-09-10T23:16:04.723 INFO:tasks.workunit.client.0.smithi046.stdout: Mkdir 4 0.007 0.008 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 240894 0.011 1.603 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 42253 0.001 0.068 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 44182 0.004 0.106 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 21636 0.014 0.230 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: Find 93152 0.039 0.826 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 132748 0.034 0.717 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 416637 0.004 0.971 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: LockX 866 0.005 0.033 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: UnlockX 866 0.003 0.022 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 18626 30.718 3514.219 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-10T23:16:04.724 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 13.9556 MB/sec 1 clients 1 procs max_latency=3514.228 ms 2024-09-10T23:16:04.725 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 10 2024-09-10T23:16:04.725 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-10T23:16:04.725 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-10T23:16:04.725 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-10T23:16:04.728 INFO:tasks.workunit.client.0.smithi046.stdout:9 of 10 processes prepared for launch 0 sec 2024-09-10T23:16:04.828 INFO:tasks.workunit.client.0.smithi046.stdout:10 of 10 processes prepared for launch 0 sec 2024-09-10T23:16:04.828 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-09-10T23:16:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:04 smithi046 ceph-mon[28128]: pgmap v669: 129 pgs: 129 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1003 KiB/s wr, 55 op/s 2024-09-10T23:16:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:04 smithi073 ceph-mon[35473]: pgmap v669: 129 pgs: 129 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 1003 KiB/s wr, 55 op/s 2024-09-10T23:16:05.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 654 70.27 MB/sec warmup 3 sec latency 80.713 ms 2024-09-10T23:16:05.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 737 213.28 MB/sec warmup 1 sec latency 96.648 ms 2024-09-10T23:16:06.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 822 53.75 MB/sec warmup 4 sec latency 98.210 ms 2024-09-10T23:16:06.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1097 113.72 MB/sec warmup 2 sec latency 174.343 ms 2024-09-10T23:16:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:06 smithi046 ceph-mon[28128]: pgmap v670: 129 pgs: 129 active+clean; 240 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.1 KiB/s rd, 8.2 MiB/s wr, 91 op/s 2024-09-10T23:16:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:06 smithi073 ceph-mon[35473]: pgmap v670: 129 pgs: 129 active+clean; 240 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.1 KiB/s rd, 8.2 MiB/s wr, 91 op/s 2024-09-10T23:16:07.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 946 43.60 MB/sec warmup 5 sec latency 73.029 ms 2024-09-10T23:16:07.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2380 93.42 MB/sec warmup 3 sec latency 317.293 ms 2024-09-10T23:16:08.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1103 38.25 MB/sec warmup 6 sec latency 96.682 ms 2024-09-10T23:16:08.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3168 85.60 MB/sec warmup 4 sec latency 674.182 ms 2024-09-10T23:16:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:08 smithi046 ceph-mon[28128]: pgmap v671: 129 pgs: 129 active+clean; 309 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 15 MiB/s wr, 115 op/s 2024-09-10T23:16:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:08 smithi073 ceph-mon[35473]: pgmap v671: 129 pgs: 129 active+clean; 309 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 15 MiB/s wr, 115 op/s 2024-09-10T23:16:09.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1190 32.90 MB/sec warmup 7 sec latency 317.869 ms 2024-09-10T23:16:09.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 4295 80.84 MB/sec warmup 5 sec latency 120.695 ms 2024-09-10T23:16:10.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1315 30.04 MB/sec warmup 8 sec latency 396.527 ms 2024-09-10T23:16:10.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 4492 68.17 MB/sec warmup 6 sec latency 95.931 ms 2024-09-10T23:16:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:10 smithi046 ceph-mon[28128]: pgmap v672: 129 pgs: 129 active+clean; 339 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 18 MiB/s wr, 121 op/s 2024-09-10T23:16:11.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:10 smithi073 ceph-mon[35473]: pgmap v672: 129 pgs: 129 active+clean; 339 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 18 MiB/s wr, 121 op/s 2024-09-10T23:16:11.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1490 28.95 MB/sec warmup 9 sec latency 93.866 ms 2024-09-10T23:16:11.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 5928 67.31 MB/sec warmup 7 sec latency 187.191 ms 2024-09-10T23:16:12.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1620 26.17 MB/sec warmup 10 sec latency 76.764 ms 2024-09-10T23:16:12.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 6969 68.73 MB/sec warmup 8 sec latency 202.848 ms 2024-09-10T23:16:13.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:12 smithi046 ceph-mon[28128]: pgmap v673: 129 pgs: 129 active+clean; 346 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 19 MiB/s wr, 175 op/s 2024-09-10T23:16:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:12 smithi073 ceph-mon[35473]: pgmap v673: 129 pgs: 129 active+clean; 346 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 19 MiB/s wr, 175 op/s 2024-09-10T23:16:13.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1773 23.90 MB/sec warmup 11 sec latency 167.687 ms 2024-09-10T23:16:13.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 7788 66.02 MB/sec warmup 9 sec latency 677.224 ms 2024-09-10T23:16:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:16:14.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:13 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:16:14.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:14.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:16:14.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:13 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:16:14.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 1881 21.98 MB/sec warmup 12 sec latency 299.648 ms 2024-09-10T23:16:14.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 7840 59.54 MB/sec warmup 10 sec latency 1026.043 ms 2024-09-10T23:16:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:14 smithi046 ceph-mon[28128]: pgmap v674: 129 pgs: 129 active+clean; 346 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 19 MiB/s wr, 156 op/s 2024-09-10T23:16:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:16:15.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:14 smithi073 ceph-mon[35473]: pgmap v674: 129 pgs: 129 active+clean; 346 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 19 MiB/s wr, 156 op/s 2024-09-10T23:16:15.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:15.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:15.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:16:15.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 2006 20.40 MB/sec warmup 13 sec latency 329.011 ms 2024-09-10T23:16:15.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 7891 54.24 MB/sec warmup 11 sec latency 899.147 ms 2024-09-10T23:16:16.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 2151 19.06 MB/sec warmup 14 sec latency 73.038 ms 2024-09-10T23:16:16.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 8273 51.17 MB/sec warmup 12 sec latency 118.668 ms 2024-09-10T23:16:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:16 smithi046 ceph-mon[28128]: pgmap v675: 129 pgs: 129 active+clean; 345 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 19 MiB/s wr, 175 op/s 2024-09-10T23:16:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:16 smithi073 ceph-mon[35473]: pgmap v675: 129 pgs: 129 active+clean; 345 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 19 MiB/s wr, 175 op/s 2024-09-10T23:16:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:17.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 2318 18.53 MB/sec warmup 15 sec latency 75.704 ms 2024-09-10T23:16:17.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 9703 52.49 MB/sec warmup 13 sec latency 184.139 ms 2024-09-10T23:16:18.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 2421 17.59 MB/sec warmup 16 sec latency 73.693 ms 2024-09-10T23:16:18.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 10702 53.63 MB/sec warmup 14 sec latency 156.173 ms 2024-09-10T23:16:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:18 smithi046 ceph-mon[28128]: pgmap v676: 129 pgs: 129 active+clean; 347 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 12 MiB/s wr, 179 op/s 2024-09-10T23:16:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:18 smithi073 ceph-mon[35473]: pgmap v676: 129 pgs: 129 active+clean; 347 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 12 MiB/s wr, 179 op/s 2024-09-10T23:16:19.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 2568 17.03 MB/sec warmup 17 sec latency 75.071 ms 2024-09-10T23:16:19.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 11401 52.46 MB/sec warmup 15 sec latency 192.986 ms 2024-09-10T23:16:20.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 2794 17.92 MB/sec warmup 18 sec latency 73.937 ms 2024-09-10T23:16:20.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 11473 49.29 MB/sec warmup 16 sec latency 476.532 ms 2024-09-10T23:16:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:20 smithi046 ceph-mon[28128]: pgmap v677: 129 pgs: 129 active+clean; 350 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 5.4 MiB/s wr, 164 op/s 2024-09-10T23:16:21.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:20 smithi073 ceph-mon[35473]: pgmap v677: 129 pgs: 129 active+clean; 350 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 5.4 MiB/s wr, 164 op/s 2024-09-10T23:16:21.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3017 17.71 MB/sec warmup 19 sec latency 179.084 ms 2024-09-10T23:16:21.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 12583 49.41 MB/sec warmup 17 sec latency 480.146 ms 2024-09-10T23:16:22.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3270 17.63 MB/sec warmup 20 sec latency 87.519 ms 2024-09-10T23:16:22.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 13713 50.73 MB/sec warmup 18 sec latency 199.292 ms 2024-09-10T23:16:23.069 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:22 smithi046 ceph-mon[28128]: pgmap v678: 129 pgs: 129 active+clean; 357 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 4.0 KiB/s rd, 3.1 MiB/s wr, 176 op/s 2024-09-10T23:16:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:22 smithi073 ceph-mon[35473]: pgmap v678: 129 pgs: 129 active+clean; 357 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 4.0 KiB/s rd, 3.1 MiB/s wr, 176 op/s 2024-09-10T23:16:23.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3303 16.84 MB/sec warmup 21 sec latency 111.224 ms 2024-09-10T23:16:23.829 INFO:tasks.workunit.client.0.smithi046.stdout: 10 14890 51.41 MB/sec warmup 19 sec latency 159.090 ms 2024-09-10T23:16:24.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3329 16.08 MB/sec warmup 22 sec latency 79.292 ms 2024-09-10T23:16:24.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 15011 48.98 MB/sec warmup 20 sec latency 177.242 ms 2024-09-10T23:16:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:24 smithi046 ceph-mon[28128]: pgmap v679: 129 pgs: 129 active+clean; 359 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.2 MiB/s wr, 122 op/s 2024-09-10T23:16:25.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:24 smithi073 ceph-mon[35473]: pgmap v679: 129 pgs: 129 active+clean; 359 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.2 MiB/s wr, 122 op/s 2024-09-10T23:16:25.409 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3440 15.81 MB/sec warmup 23 sec latency 77.519 ms 2024-09-10T23:16:25.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 15910 48.91 MB/sec warmup 21 sec latency 134.423 ms 2024-09-10T23:16:26.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3659 16.19 MB/sec warmup 24 sec latency 77.148 ms 2024-09-10T23:16:26.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 17245 50.15 MB/sec warmup 22 sec latency 116.705 ms 2024-09-10T23:16:27.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:26 smithi046 ceph-mon[28128]: pgmap v680: 129 pgs: 129 active+clean; 367 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 133 op/s 2024-09-10T23:16:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:26 smithi073 ceph-mon[35473]: pgmap v680: 129 pgs: 129 active+clean; 367 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 133 op/s 2024-09-10T23:16:27.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3792 15.91 MB/sec warmup 25 sec latency 85.724 ms 2024-09-10T23:16:27.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 18442 50.79 MB/sec warmup 23 sec latency 177.212 ms 2024-09-10T23:16:28.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3879 15.32 MB/sec warmup 26 sec latency 79.757 ms 2024-09-10T23:16:28.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 18575 48.80 MB/sec warmup 24 sec latency 108.616 ms 2024-09-10T23:16:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:28 smithi046 ceph-mon[28128]: pgmap v681: 129 pgs: 129 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 4.0 MiB/s wr, 147 op/s 2024-09-10T23:16:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:28 smithi073 ceph-mon[35473]: pgmap v681: 129 pgs: 129 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 4.0 MiB/s wr, 147 op/s 2024-09-10T23:16:29.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 3965 14.84 MB/sec warmup 27 sec latency 97.353 ms 2024-09-10T23:16:29.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 19635 48.84 MB/sec warmup 25 sec latency 133.596 ms 2024-09-10T23:16:30.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4052 14.31 MB/sec warmup 28 sec latency 101.252 ms 2024-09-10T23:16:30.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 20840 49.85 MB/sec warmup 26 sec latency 279.839 ms 2024-09-10T23:16:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:30 smithi073 ceph-mon[35473]: pgmap v682: 129 pgs: 129 active+clean; 376 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 4.5 MiB/s wr, 113 op/s 2024-09-10T23:16:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:30 smithi046 ceph-mon[28128]: pgmap v682: 129 pgs: 129 active+clean; 376 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 4.5 MiB/s wr, 113 op/s 2024-09-10T23:16:31.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4106 13.83 MB/sec warmup 29 sec latency 437.557 ms 2024-09-10T23:16:31.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 21226 48.87 MB/sec warmup 27 sec latency 876.076 ms 2024-09-10T23:16:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:32.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4221 13.40 MB/sec warmup 30 sec latency 462.492 ms 2024-09-10T23:16:32.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 22070 48.60 MB/sec warmup 28 sec latency 119.292 ms 2024-09-10T23:16:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:32 smithi046 ceph-mon[28128]: pgmap v683: 129 pgs: 129 active+clean; 379 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 109 op/s 2024-09-10T23:16:33.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:32 smithi073 ceph-mon[35473]: pgmap v683: 129 pgs: 129 active+clean; 379 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 109 op/s 2024-09-10T23:16:33.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4366 13.08 MB/sec warmup 31 sec latency 99.147 ms 2024-09-10T23:16:33.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 22315 47.24 MB/sec warmup 29 sec latency 105.950 ms 2024-09-10T23:16:34.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4496 12.83 MB/sec warmup 32 sec latency 107.138 ms 2024-09-10T23:16:34.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 23697 47.70 MB/sec warmup 30 sec latency 149.059 ms 2024-09-10T23:16:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:34 smithi046 ceph-mon[28128]: pgmap v684: 129 pgs: 129 active+clean; 382 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.9 MiB/s wr, 95 op/s 2024-09-10T23:16:35.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:34 smithi073 ceph-mon[35473]: pgmap v684: 129 pgs: 129 active+clean; 382 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.9 MiB/s wr, 95 op/s 2024-09-10T23:16:35.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4626 12.74 MB/sec warmup 33 sec latency 127.858 ms 2024-09-10T23:16:35.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 24906 48.91 MB/sec warmup 31 sec latency 175.959 ms 2024-09-10T23:16:36.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4757 12.40 MB/sec warmup 34 sec latency 87.725 ms 2024-09-10T23:16:36.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25626 48.51 MB/sec warmup 32 sec latency 147.541 ms 2024-09-10T23:16:37.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:36 smithi046 ceph-mon[28128]: pgmap v685: 129 pgs: 129 active+clean; 377 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.8 MiB/s wr, 113 op/s 2024-09-10T23:16:37.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:36 smithi073 ceph-mon[35473]: pgmap v685: 129 pgs: 129 active+clean; 377 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.8 MiB/s wr, 113 op/s 2024-09-10T23:16:37.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4846 12.23 MB/sec warmup 35 sec latency 439.076 ms 2024-09-10T23:16:37.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25634 47.05 MB/sec warmup 33 sec latency 992.089 ms 2024-09-10T23:16:38.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4929 12.22 MB/sec warmup 36 sec latency 497.857 ms 2024-09-10T23:16:38.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25635 45.66 MB/sec warmup 34 sec latency 1250.568 ms 2024-09-10T23:16:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:38 smithi046 ceph-mon[28128]: pgmap v686: 129 pgs: 129 active+clean; 370 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 162 op/s 2024-09-10T23:16:39.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:38 smithi073 ceph-mon[35473]: pgmap v686: 129 pgs: 129 active+clean; 370 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 162 op/s 2024-09-10T23:16:39.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 4932 11.89 MB/sec warmup 37 sec latency 756.316 ms 2024-09-10T23:16:39.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25643 44.36 MB/sec warmup 35 sec latency 1486.735 ms 2024-09-10T23:16:40.410 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5036 11.89 MB/sec warmup 38 sec latency 514.503 ms 2024-09-10T23:16:40.830 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25671 43.15 MB/sec warmup 36 sec latency 1626.433 ms 2024-09-10T23:16:41.131 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:40 smithi073 ceph-mon[35473]: pgmap v687: 129 pgs: 129 active+clean; 360 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 3.0 MiB/s wr, 146 op/s 2024-09-10T23:16:41.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:40 smithi046 ceph-mon[28128]: pgmap v687: 129 pgs: 129 active+clean; 360 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 3.0 MiB/s wr, 146 op/s 2024-09-10T23:16:41.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5153 11.60 MB/sec warmup 39 sec latency 199.988 ms 2024-09-10T23:16:41.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25672 41.98 MB/sec warmup 37 sec latency 1321.449 ms 2024-09-10T23:16:42.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5195 11.32 MB/sec warmup 40 sec latency 474.064 ms 2024-09-10T23:16:42.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25679 40.88 MB/sec warmup 38 sec latency 1387.205 ms 2024-09-10T23:16:43.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:42 smithi046 ceph-mon[28128]: pgmap v688: 129 pgs: 129 active+clean; 361 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 164 op/s 2024-09-10T23:16:43.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:42 smithi073 ceph-mon[35473]: pgmap v688: 129 pgs: 129 active+clean; 361 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 164 op/s 2024-09-10T23:16:43.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5284 11.07 MB/sec warmup 41 sec latency 522.960 ms 2024-09-10T23:16:43.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25688 39.84 MB/sec warmup 39 sec latency 1414.115 ms 2024-09-10T23:16:44.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5360 10.82 MB/sec warmup 42 sec latency 390.189 ms 2024-09-10T23:16:44.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25698 38.85 MB/sec warmup 40 sec latency 1338.617 ms 2024-09-10T23:16:45.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:44 smithi046 ceph-mon[28128]: pgmap v689: 129 pgs: 129 active+clean; 361 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 154 op/s 2024-09-10T23:16:45.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:44 smithi073 ceph-mon[35473]: pgmap v689: 129 pgs: 129 active+clean; 361 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 154 op/s 2024-09-10T23:16:45.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5442 10.58 MB/sec warmup 43 sec latency 491.211 ms 2024-09-10T23:16:45.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25698 37.90 MB/sec warmup 41 sec latency 1068.410 ms 2024-09-10T23:16:46.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5503 10.36 MB/sec warmup 44 sec latency 416.640 ms 2024-09-10T23:16:46.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25713 37.01 MB/sec warmup 42 sec latency 1459.707 ms 2024-09-10T23:16:47.235 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:46 smithi046 ceph-mon[28128]: pgmap v690: 129 pgs: 129 active+clean; 361 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 1.8 MiB/s wr, 144 op/s 2024-09-10T23:16:47.236 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:46 smithi073 ceph-mon[35473]: pgmap v690: 129 pgs: 129 active+clean; 361 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 1.8 MiB/s wr, 144 op/s 2024-09-10T23:16:47.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:16:47.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5581 10.15 MB/sec warmup 45 sec latency 499.682 ms 2024-09-10T23:16:47.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25717 36.15 MB/sec warmup 43 sec latency 1376.187 ms 2024-09-10T23:16:48.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5651 9.95 MB/sec warmup 46 sec latency 452.375 ms 2024-09-10T23:16:48.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25734 35.34 MB/sec warmup 44 sec latency 1450.746 ms 2024-09-10T23:16:49.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:48 smithi046 ceph-mon[28128]: pgmap v691: 129 pgs: 129 active+clean; 362 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 MiB/s wr, 148 op/s 2024-09-10T23:16:49.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:48 smithi073 ceph-mon[35473]: pgmap v691: 129 pgs: 129 active+clean; 362 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 MiB/s wr, 148 op/s 2024-09-10T23:16:49.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5718 9.79 MB/sec warmup 47 sec latency 414.636 ms 2024-09-10T23:16:49.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25770 34.57 MB/sec warmup 45 sec latency 1231.841 ms 2024-09-10T23:16:50.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5802 9.64 MB/sec warmup 48 sec latency 384.401 ms 2024-09-10T23:16:50.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 25792 33.83 MB/sec warmup 46 sec latency 1412.686 ms 2024-09-10T23:16:51.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:50 smithi046 ceph-mon[28128]: pgmap v692: 129 pgs: 129 active+clean; 362 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2024-09-10T23:16:51.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:50 smithi073 ceph-mon[35473]: pgmap v692: 129 pgs: 129 active+clean; 362 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2024-09-10T23:16:51.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 5904 9.59 MB/sec warmup 49 sec latency 481.710 ms 2024-09-10T23:16:51.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 26529 34.06 MB/sec warmup 47 sec latency 607.248 ms 2024-09-10T23:16:52.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6008 9.48 MB/sec warmup 50 sec latency 92.709 ms 2024-09-10T23:16:52.831 INFO:tasks.workunit.client.0.smithi046.stdout: 10 27900 34.94 MB/sec warmup 48 sec latency 135.147 ms 2024-09-10T23:16:53.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:52 smithi046 ceph-mon[28128]: pgmap v693: 129 pgs: 129 active+clean; 363 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 811 KiB/s wr, 95 op/s 2024-09-10T23:16:53.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:52 smithi073 ceph-mon[35473]: pgmap v693: 129 pgs: 129 active+clean; 363 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 811 KiB/s wr, 95 op/s 2024-09-10T23:16:53.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6157 9.54 MB/sec warmup 51 sec latency 102.734 ms 2024-09-10T23:16:53.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 29109 35.55 MB/sec warmup 49 sec latency 180.649 ms 2024-09-10T23:16:54.411 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6369 9.85 MB/sec warmup 52 sec latency 92.110 ms 2024-09-10T23:16:54.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 29222 34.90 MB/sec warmup 50 sec latency 185.599 ms 2024-09-10T23:16:55.181 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:54 smithi046 ceph-mon[28128]: pgmap v694: 129 pgs: 129 active+clean; 363 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 446 KiB/s wr, 70 op/s 2024-09-10T23:16:55.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:54 smithi073 ceph-mon[35473]: pgmap v694: 129 pgs: 129 active+clean; 363 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 446 KiB/s wr, 70 op/s 2024-09-10T23:16:55.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6613 10.01 MB/sec warmup 53 sec latency 90.009 ms 2024-09-10T23:16:55.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 29806 34.80 MB/sec warmup 51 sec latency 185.878 ms 2024-09-10T23:16:56.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6830 10.07 MB/sec warmup 54 sec latency 96.292 ms 2024-09-10T23:16:56.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 30400 34.58 MB/sec warmup 52 sec latency 598.122 ms 2024-09-10T23:16:57.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:56 smithi046 ceph-mon[28128]: pgmap v695: 129 pgs: 129 active+clean; 367 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-10T23:16:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:56 smithi073 ceph-mon[35473]: pgmap v695: 129 pgs: 129 active+clean; 367 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-10T23:16:57.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6852 9.90 MB/sec warmup 55 sec latency 474.549 ms 2024-09-10T23:16:57.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 30549 34.00 MB/sec warmup 53 sec latency 1065.420 ms 2024-09-10T23:16:58.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6863 9.73 MB/sec warmup 56 sec latency 487.477 ms 2024-09-10T23:16:58.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 30615 33.41 MB/sec warmup 54 sec latency 1417.844 ms 2024-09-10T23:16:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:16:58 smithi046 ceph-mon[28128]: pgmap v696: 129 pgs: 129 active+clean; 381 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.7 MiB/s wr, 111 op/s 2024-09-10T23:16:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:16:58 smithi073 ceph-mon[35473]: pgmap v696: 129 pgs: 129 active+clean; 381 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.7 MiB/s wr, 111 op/s 2024-09-10T23:16:59.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6878 9.56 MB/sec warmup 57 sec latency 454.017 ms 2024-09-10T23:16:59.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 31404 33.89 MB/sec warmup 55 sec latency 1072.176 ms 2024-09-10T23:17:00.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 6965 9.56 MB/sec warmup 58 sec latency 98.203 ms 2024-09-10T23:17:00.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 32663 34.52 MB/sec warmup 56 sec latency 197.201 ms 2024-09-10T23:17:01.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:00 smithi046 ceph-mon[28128]: pgmap v697: 129 pgs: 129 active+clean; 387 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 3.2 MiB/s wr, 91 op/s 2024-09-10T23:17:01.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:00 smithi073 ceph-mon[35473]: pgmap v697: 129 pgs: 129 active+clean; 387 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 3.2 MiB/s wr, 91 op/s 2024-09-10T23:17:01.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7160 9.80 MB/sec warmup 59 sec latency 81.713 ms 2024-09-10T23:17:01.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 32795 33.98 MB/sec warmup 57 sec latency 108.849 ms 2024-09-10T23:17:02.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:02.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:02.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7296 9.73 MB/sec warmup 60 sec latency 73.144 ms 2024-09-10T23:17:02.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 33775 34.23 MB/sec warmup 58 sec latency 124.899 ms 2024-09-10T23:17:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:02 smithi046 ceph-mon[28128]: pgmap v698: 129 pgs: 129 active+clean; 388 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.5 MiB/s wr, 93 op/s 2024-09-10T23:17:03.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:02 smithi073 ceph-mon[35473]: pgmap v698: 129 pgs: 129 active+clean; 388 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.5 MiB/s wr, 93 op/s 2024-09-10T23:17:03.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7404 9.66 MB/sec warmup 61 sec latency 110.244 ms 2024-09-10T23:17:03.832 INFO:tasks.workunit.client.0.smithi046.stdout: 10 35032 34.92 MB/sec warmup 59 sec latency 176.699 ms 2024-09-10T23:17:04.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7494 9.54 MB/sec warmup 62 sec latency 77.976 ms 2024-09-10T23:17:04.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 35738 34.99 MB/sec warmup 60 sec latency 484.651 ms 2024-09-10T23:17:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:04 smithi046 ceph-mon[28128]: pgmap v699: 129 pgs: 129 active+clean; 390 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 3.5 MiB/s wr, 93 op/s 2024-09-10T23:17:05.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:04 smithi073 ceph-mon[35473]: pgmap v699: 129 pgs: 129 active+clean; 390 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 3.5 MiB/s wr, 93 op/s 2024-09-10T23:17:05.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7548 9.39 MB/sec warmup 63 sec latency 417.072 ms 2024-09-10T23:17:05.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 35908 34.58 MB/sec warmup 61 sec latency 1045.104 ms 2024-09-10T23:17:06.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7582 9.25 MB/sec warmup 64 sec latency 447.541 ms 2024-09-10T23:17:06.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 35998 34.10 MB/sec warmup 62 sec latency 1368.182 ms 2024-09-10T23:17:07.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:06 smithi046 ceph-mon[28128]: pgmap v700: 129 pgs: 129 active+clean; 394 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 119 op/s 2024-09-10T23:17:07.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:06 smithi073 ceph-mon[35473]: pgmap v700: 129 pgs: 129 active+clean; 394 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 119 op/s 2024-09-10T23:17:07.412 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7630 9.11 MB/sec warmup 65 sec latency 526.564 ms 2024-09-10T23:17:07.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 36286 33.75 MB/sec warmup 63 sec latency 550.765 ms 2024-09-10T23:17:08.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7758 8.99 MB/sec warmup 66 sec latency 86.348 ms 2024-09-10T23:17:08.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 36773 33.63 MB/sec warmup 64 sec latency 176.294 ms 2024-09-10T23:17:09.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:08 smithi046 ceph-mon[28128]: pgmap v701: 129 pgs: 129 active+clean; 396 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 4.4 MiB/s wr, 108 op/s 2024-09-10T23:17:09.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:08 smithi073 ceph-mon[35473]: pgmap v701: 129 pgs: 129 active+clean; 396 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 4.4 MiB/s wr, 108 op/s 2024-09-10T23:17:09.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 7902 8.91 MB/sec warmup 67 sec latency 87.115 ms 2024-09-10T23:17:09.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 38048 34.07 MB/sec warmup 65 sec latency 150.471 ms 2024-09-10T23:17:10.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8033 8.85 MB/sec warmup 68 sec latency 136.782 ms 2024-09-10T23:17:10.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 39280 34.71 MB/sec warmup 66 sec latency 132.329 ms 2024-09-10T23:17:11.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:10 smithi046 ceph-mon[28128]: pgmap v702: 129 pgs: 129 active+clean; 394 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.0 MiB/s wr, 76 op/s 2024-09-10T23:17:11.335 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:10 smithi073 ceph-mon[35473]: pgmap v702: 129 pgs: 129 active+clean; 394 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.0 MiB/s wr, 76 op/s 2024-09-10T23:17:11.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8169 8.82 MB/sec warmup 69 sec latency 119.764 ms 2024-09-10T23:17:11.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 39803 34.58 MB/sec warmup 67 sec latency 192.662 ms 2024-09-10T23:17:12.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8321 8.84 MB/sec warmup 70 sec latency 93.020 ms 2024-09-10T23:17:12.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 39841 34.09 MB/sec warmup 68 sec latency 755.205 ms 2024-09-10T23:17:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:12 smithi046 ceph-mon[28128]: pgmap v703: 129 pgs: 129 active+clean; 389 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.9 MiB/s wr, 124 op/s 2024-09-10T23:17:13.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:12 smithi073 ceph-mon[35473]: pgmap v703: 129 pgs: 129 active+clean; 389 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.9 MiB/s wr, 124 op/s 2024-09-10T23:17:13.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8375 8.72 MB/sec warmup 71 sec latency 432.727 ms 2024-09-10T23:17:13.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 39848 33.59 MB/sec warmup 69 sec latency 1101.029 ms 2024-09-10T23:17:14.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8433 8.72 MB/sec warmup 72 sec latency 607.122 ms 2024-09-10T23:17:14.833 INFO:tasks.workunit.client.0.smithi046.stdout: 10 39850 33.12 MB/sec warmup 70 sec latency 1370.529 ms 2024-09-10T23:17:15.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:14 smithi046 ceph-mon[28128]: pgmap v704: 129 pgs: 129 active+clean; 386 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 120 op/s 2024-09-10T23:17:15.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:14 smithi073 ceph-mon[35473]: pgmap v704: 129 pgs: 129 active+clean; 386 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 120 op/s 2024-09-10T23:17:15.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8547 8.80 MB/sec warmup 73 sec latency 597.372 ms 2024-09-10T23:17:15.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 40443 33.05 MB/sec warmup 71 sec latency 798.240 ms 2024-09-10T23:17:16.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:15 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:16.331 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:15 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:16.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8661 8.69 MB/sec warmup 74 sec latency 108.553 ms 2024-09-10T23:17:16.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 41828 33.61 MB/sec warmup 72 sec latency 142.655 ms 2024-09-10T23:17:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:16 smithi046 ceph-mon[28128]: pgmap v705: 129 pgs: 129 active+clean; 379 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.2 MiB/s wr, 147 op/s 2024-09-10T23:17:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:17:17.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:16 smithi073 ceph-mon[35473]: pgmap v705: 129 pgs: 129 active+clean; 379 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.2 MiB/s wr, 147 op/s 2024-09-10T23:17:17.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8795 8.59 MB/sec warmup 75 sec latency 88.392 ms 2024-09-10T23:17:17.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 42916 34.07 MB/sec warmup 73 sec latency 137.581 ms 2024-09-10T23:17:18.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 8952 8.50 MB/sec warmup 76 sec latency 74.077 ms 2024-09-10T23:17:18.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 43377 33.90 MB/sec warmup 74 sec latency 122.314 ms 2024-09-10T23:17:19.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9083 8.41 MB/sec warmup 77 sec latency 77.995 ms 2024-09-10T23:17:19.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 43942 33.80 MB/sec warmup 75 sec latency 107.947 ms 2024-09-10T23:17:20.025 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:19 smithi046 ceph-mon[28128]: pgmap v706: 129 pgs: 129 active+clean; 376 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-09-10T23:17:20.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:19 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:20.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:19 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:20.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:19 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:17:20.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:19 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:20.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:19 smithi073 ceph-mon[35473]: pgmap v706: 129 pgs: 129 active+clean; 376 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-09-10T23:17:20.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9189 8.32 MB/sec warmup 78 sec latency 385.725 ms 2024-09-10T23:17:20.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 44653 33.76 MB/sec warmup 76 sec latency 595.107 ms 2024-09-10T23:17:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:20 smithi046 ceph-mon[28128]: pgmap v707: 129 pgs: 129 active+clean; 376 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 1.9 MiB/s wr, 144 op/s 2024-09-10T23:17:21.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:20 smithi073 ceph-mon[35473]: pgmap v707: 129 pgs: 129 active+clean; 376 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 1.9 MiB/s wr, 144 op/s 2024-09-10T23:17:21.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9241 8.24 MB/sec warmup 79 sec latency 426.788 ms 2024-09-10T23:17:21.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 44693 33.33 MB/sec warmup 77 sec latency 920.267 ms 2024-09-10T23:17:22.413 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9329 8.16 MB/sec warmup 80 sec latency 457.059 ms 2024-09-10T23:17:22.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 44978 33.14 MB/sec warmup 78 sec latency 921.062 ms 2024-09-10T23:17:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:22 smithi046 ceph-mon[28128]: pgmap v708: 129 pgs: 129 active+clean; 378 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.0 KiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-10T23:17:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:22 smithi073 ceph-mon[35473]: pgmap v708: 129 pgs: 129 active+clean; 378 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 7.0 KiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-10T23:17:23.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9473 8.18 MB/sec warmup 81 sec latency 77.646 ms 2024-09-10T23:17:23.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 46303 33.79 MB/sec warmup 79 sec latency 148.884 ms 2024-09-10T23:17:24.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9537 8.13 MB/sec warmup 82 sec latency 940.441 ms 2024-09-10T23:17:24.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 46876 33.74 MB/sec warmup 80 sec latency 249.812 ms 2024-09-10T23:17:25.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:24 smithi046 ceph-mon[28128]: pgmap v709: 129 pgs: 129 active+clean; 378 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-10T23:17:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:24 smithi073 ceph-mon[35473]: pgmap v709: 129 pgs: 129 active+clean; 378 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-10T23:17:25.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9592 8.06 MB/sec warmup 83 sec latency 1528.070 ms 2024-09-10T23:17:25.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 47129 33.43 MB/sec warmup 81 sec latency 98.605 ms 2024-09-10T23:17:26.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9744 8.09 MB/sec warmup 84 sec latency 106.425 ms 2024-09-10T23:17:26.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 48302 33.66 MB/sec warmup 82 sec latency 167.795 ms 2024-09-10T23:17:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:26 smithi046 ceph-mon[28128]: pgmap v710: 129 pgs: 129 active+clean; 379 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-09-10T23:17:27.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:26 smithi073 ceph-mon[35473]: pgmap v710: 129 pgs: 129 active+clean; 379 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-09-10T23:17:27.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 9957 8.29 MB/sec warmup 85 sec latency 88.432 ms 2024-09-10T23:17:27.834 INFO:tasks.workunit.client.0.smithi046.stdout: 10 49040 33.86 MB/sec warmup 83 sec latency 428.549 ms 2024-09-10T23:17:28.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10101 8.35 MB/sec warmup 86 sec latency 479.445 ms 2024-09-10T23:17:28.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 49040 33.46 MB/sec warmup 84 sec latency 1428.702 ms 2024-09-10T23:17:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:28 smithi046 ceph-mon[28128]: pgmap v711: 129 pgs: 129 active+clean; 385 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 MiB/s wr, 116 op/s 2024-09-10T23:17:29.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:28 smithi073 ceph-mon[35473]: pgmap v711: 129 pgs: 129 active+clean; 385 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 MiB/s wr, 116 op/s 2024-09-10T23:17:29.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10101 8.26 MB/sec warmup 87 sec latency 1479.602 ms 2024-09-10T23:17:29.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 49215 33.20 MB/sec warmup 85 sec latency 2219.890 ms 2024-09-10T23:17:30.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10212 8.22 MB/sec warmup 88 sec latency 1532.819 ms 2024-09-10T23:17:30.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:30 smithi046 ceph-mon[28128]: pgmap v712: 129 pgs: 129 active+clean; 386 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 MiB/s wr, 100 op/s 2024-09-10T23:17:30.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 50405 33.60 MB/sec warmup 86 sec latency 114.195 ms 2024-09-10T23:17:31.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:30 smithi073 ceph-mon[35473]: pgmap v712: 129 pgs: 129 active+clean; 386 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 MiB/s wr, 100 op/s 2024-09-10T23:17:31.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10417 8.30 MB/sec warmup 89 sec latency 107.048 ms 2024-09-10T23:17:31.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 50569 33.26 MB/sec warmup 87 sec latency 112.225 ms 2024-09-10T23:17:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:32.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10462 8.23 MB/sec warmup 90 sec latency 80.137 ms 2024-09-10T23:17:32.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 51838 33.53 MB/sec warmup 88 sec latency 113.638 ms 2024-09-10T23:17:33.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:32 smithi046 ceph-mon[28128]: pgmap v713: 129 pgs: 129 active+clean; 398 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 2.9 MiB/s wr, 105 op/s 2024-09-10T23:17:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:32 smithi073 ceph-mon[35473]: pgmap v713: 129 pgs: 129 active+clean; 398 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 2.9 MiB/s wr, 105 op/s 2024-09-10T23:17:33.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10516 8.18 MB/sec warmup 91 sec latency 85.648 ms 2024-09-10T23:17:33.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 53201 34.17 MB/sec warmup 89 sec latency 127.936 ms 2024-09-10T23:17:34.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10686 8.32 MB/sec warmup 92 sec latency 74.025 ms 2024-09-10T23:17:34.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 53965 34.24 MB/sec warmup 90 sec latency 122.575 ms 2024-09-10T23:17:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:34 smithi046 ceph-mon[28128]: pgmap v714: 129 pgs: 129 active+clean; 402 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 3.0 MiB/s wr, 85 op/s 2024-09-10T23:17:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:34 smithi073 ceph-mon[35473]: pgmap v714: 129 pgs: 129 active+clean; 402 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 3.0 MiB/s wr, 85 op/s 2024-09-10T23:17:35.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10846 8.33 MB/sec warmup 93 sec latency 74.694 ms 2024-09-10T23:17:35.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 54213 33.96 MB/sec warmup 91 sec latency 100.669 ms 2024-09-10T23:17:36.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 10961 8.30 MB/sec warmup 94 sec latency 110.919 ms 2024-09-10T23:17:36.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 55581 34.31 MB/sec warmup 92 sec latency 132.177 ms 2024-09-10T23:17:37.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:36 smithi046 ceph-mon[28128]: pgmap v715: 129 pgs: 129 active+clean; 405 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.7 MiB/s wr, 94 op/s 2024-09-10T23:17:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:36 smithi073 ceph-mon[35473]: pgmap v715: 129 pgs: 129 active+clean; 405 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.7 MiB/s wr, 94 op/s 2024-09-10T23:17:37.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11055 8.24 MB/sec warmup 95 sec latency 86.233 ms 2024-09-10T23:17:37.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 56878 34.87 MB/sec warmup 93 sec latency 147.015 ms 2024-09-10T23:17:38.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11140 8.16 MB/sec warmup 96 sec latency 136.403 ms 2024-09-10T23:17:38.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 57538 34.82 MB/sec warmup 94 sec latency 109.897 ms 2024-09-10T23:17:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:38 smithi046 ceph-mon[28128]: pgmap v716: 129 pgs: 129 active+clean; 408 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 4.0 MiB/s wr, 109 op/s 2024-09-10T23:17:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:38 smithi073 ceph-mon[35473]: pgmap v716: 129 pgs: 129 active+clean; 408 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 4.0 MiB/s wr, 109 op/s 2024-09-10T23:17:39.414 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11242 8.09 MB/sec warmup 97 sec latency 82.527 ms 2024-09-10T23:17:39.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 57860 34.63 MB/sec warmup 95 sec latency 109.917 ms 2024-09-10T23:17:40.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11348 8.02 MB/sec warmup 98 sec latency 131.778 ms 2024-09-10T23:17:40.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 59271 35.00 MB/sec warmup 96 sec latency 116.255 ms 2024-09-10T23:17:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:40 smithi046 ceph-mon[28128]: pgmap v717: 129 pgs: 129 active+clean; 408 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.4 MiB/s wr, 85 op/s 2024-09-10T23:17:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:40 smithi073 ceph-mon[35473]: pgmap v717: 129 pgs: 129 active+clean; 408 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.4 MiB/s wr, 85 op/s 2024-09-10T23:17:41.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11476 7.97 MB/sec warmup 99 sec latency 143.035 ms 2024-09-10T23:17:41.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 60486 35.40 MB/sec warmup 97 sec latency 125.118 ms 2024-09-10T23:17:42.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11620 7.96 MB/sec warmup 100 sec latency 106.611 ms 2024-09-10T23:17:42.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 61088 35.35 MB/sec warmup 98 sec latency 191.385 ms 2024-09-10T23:17:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:42 smithi046 ceph-mon[28128]: pgmap v718: 129 pgs: 129 active+clean; 412 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 118 op/s 2024-09-10T23:17:43.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:42 smithi073 ceph-mon[35473]: pgmap v718: 129 pgs: 129 active+clean; 412 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 118 op/s 2024-09-10T23:17:43.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11757 7.94 MB/sec warmup 101 sec latency 80.163 ms 2024-09-10T23:17:43.835 INFO:tasks.workunit.client.0.smithi046.stdout: 10 61404 35.16 MB/sec warmup 99 sec latency 292.351 ms 2024-09-10T23:17:44.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 11909 7.94 MB/sec warmup 102 sec latency 86.390 ms 2024-09-10T23:17:44.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 62814 35.51 MB/sec warmup 100 sec latency 124.472 ms 2024-09-10T23:17:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:44 smithi046 ceph-mon[28128]: pgmap v719: 129 pgs: 129 active+clean; 412 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 101 op/s 2024-09-10T23:17:45.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:44 smithi073 ceph-mon[35473]: pgmap v719: 129 pgs: 129 active+clean; 412 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 101 op/s 2024-09-10T23:17:45.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12022 7.96 MB/sec warmup 103 sec latency 253.565 ms 2024-09-10T23:17:45.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 63212 35.40 MB/sec warmup 101 sec latency 637.924 ms 2024-09-10T23:17:46.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12181 8.02 MB/sec warmup 104 sec latency 271.937 ms 2024-09-10T23:17:46.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 64370 35.72 MB/sec warmup 102 sec latency 137.672 ms 2024-09-10T23:17:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:46 smithi046 ceph-mon[28128]: pgmap v720: 129 pgs: 129 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.6 MiB/s wr, 153 op/s 2024-09-10T23:17:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:46 smithi073 ceph-mon[35473]: pgmap v720: 129 pgs: 129 active+clean; 404 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.6 MiB/s wr, 153 op/s 2024-09-10T23:17:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:17:47.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12314 7.96 MB/sec warmup 105 sec latency 85.522 ms 2024-09-10T23:17:47.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 64662 35.50 MB/sec warmup 103 sec latency 126.418 ms 2024-09-10T23:17:48.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12477 7.91 MB/sec warmup 106 sec latency 76.501 ms 2024-09-10T23:17:48.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 65343 35.45 MB/sec warmup 104 sec latency 125.793 ms 2024-09-10T23:17:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:48 smithi046 ceph-mon[28128]: pgmap v721: 129 pgs: 129 active+clean; 392 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 3.4 MiB/s wr, 172 op/s 2024-09-10T23:17:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:48 smithi073 ceph-mon[35473]: pgmap v721: 129 pgs: 129 active+clean; 392 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 3.4 MiB/s wr, 172 op/s 2024-09-10T23:17:49.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12622 7.85 MB/sec warmup 107 sec latency 86.661 ms 2024-09-10T23:17:49.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 66624 35.77 MB/sec warmup 105 sec latency 119.929 ms 2024-09-10T23:17:50.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12771 7.80 MB/sec warmup 108 sec latency 137.718 ms 2024-09-10T23:17:50.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 67344 35.88 MB/sec warmup 106 sec latency 401.612 ms 2024-09-10T23:17:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:50 smithi046 ceph-mon[28128]: pgmap v722: 129 pgs: 129 active+clean; 391 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2024-09-10T23:17:51.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:50 smithi073 ceph-mon[35473]: pgmap v722: 129 pgs: 129 active+clean; 391 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2024-09-10T23:17:51.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 12892 7.77 MB/sec warmup 109 sec latency 281.375 ms 2024-09-10T23:17:51.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 67917 35.84 MB/sec warmup 107 sec latency 899.700 ms 2024-09-10T23:17:52.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13060 7.80 MB/sec warmup 110 sec latency 83.253 ms 2024-09-10T23:17:52.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 68214 35.63 MB/sec warmup 108 sec latency 132.396 ms 2024-09-10T23:17:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:52 smithi046 ceph-mon[28128]: pgmap v723: 129 pgs: 129 active+clean; 394 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.7 KiB/s rd, 2.8 MiB/s wr, 202 op/s 2024-09-10T23:17:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:52 smithi073 ceph-mon[35473]: pgmap v723: 129 pgs: 129 active+clean; 394 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.7 KiB/s rd, 2.8 MiB/s wr, 202 op/s 2024-09-10T23:17:53.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13187 7.78 MB/sec warmup 111 sec latency 89.655 ms 2024-09-10T23:17:53.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 68686 35.53 MB/sec warmup 109 sec latency 396.283 ms 2024-09-10T23:17:54.415 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13321 7.79 MB/sec warmup 112 sec latency 101.197 ms 2024-09-10T23:17:54.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 69980 35.80 MB/sec warmup 110 sec latency 129.922 ms 2024-09-10T23:17:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:54 smithi046 ceph-mon[28128]: pgmap v724: 129 pgs: 129 active+clean; 394 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-10T23:17:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:54 smithi073 ceph-mon[35473]: pgmap v724: 129 pgs: 129 active+clean; 394 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-10T23:17:55.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13534 7.97 MB/sec warmup 113 sec latency 97.238 ms 2024-09-10T23:17:55.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 71125 36.11 MB/sec warmup 111 sec latency 166.247 ms 2024-09-10T23:17:56.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13649 7.96 MB/sec warmup 114 sec latency 465.273 ms 2024-09-10T23:17:56.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 71502 35.97 MB/sec warmup 112 sec latency 543.293 ms 2024-09-10T23:17:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:56 smithi046 ceph-mon[28128]: pgmap v725: 129 pgs: 129 active+clean; 401 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.9 MiB/s wr, 191 op/s 2024-09-10T23:17:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:56 smithi073 ceph-mon[35473]: pgmap v725: 129 pgs: 129 active+clean; 401 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.9 MiB/s wr, 191 op/s 2024-09-10T23:17:57.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13845 8.02 MB/sec warmup 115 sec latency 143.582 ms 2024-09-10T23:17:57.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 71794 35.75 MB/sec warmup 113 sec latency 192.058 ms 2024-09-10T23:17:58.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 13987 8.02 MB/sec warmup 116 sec latency 99.557 ms 2024-09-10T23:17:58.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 72432 35.70 MB/sec warmup 114 sec latency 217.887 ms 2024-09-10T23:17:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:17:58 smithi046 ceph-mon[28128]: pgmap v726: 129 pgs: 129 active+clean; 408 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.0 MiB/s wr, 152 op/s 2024-09-10T23:17:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:17:58 smithi073 ceph-mon[35473]: pgmap v726: 129 pgs: 129 active+clean; 408 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.0 MiB/s wr, 152 op/s 2024-09-10T23:17:59.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14026 7.96 MB/sec warmup 117 sec latency 82.513 ms 2024-09-10T23:17:59.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 73722 35.99 MB/sec warmup 115 sec latency 169.493 ms 2024-09-10T23:18:00.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14088 7.93 MB/sec warmup 118 sec latency 86.789 ms 2024-09-10T23:18:00.836 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75040 36.36 MB/sec warmup 116 sec latency 160.104 ms 2024-09-10T23:18:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:00 smithi046 ceph-mon[28128]: pgmap v727: 129 pgs: 129 active+clean; 411 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2024-09-10T23:18:01.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:00 smithi073 ceph-mon[35473]: pgmap v727: 129 pgs: 129 active+clean; 411 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2024-09-10T23:18:01.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14273 8.08 MB/sec warmup 119 sec latency 101.952 ms 2024-09-10T23:18:01.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75316 36.16 MB/sec warmup 117 sec latency 162.762 ms 2024-09-10T23:18:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:02.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75318 35.85 MB/sec warmup 118 sec latency 900.720 ms 2024-09-10T23:18:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:02 smithi046 ceph-mon[28128]: pgmap v728: 129 pgs: 129 active+clean; 420 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.9 MiB/s wr, 152 op/s 2024-09-10T23:18:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:02 smithi073 ceph-mon[35473]: pgmap v728: 129 pgs: 129 active+clean; 420 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.9 MiB/s wr, 152 op/s 2024-09-10T23:18:03.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14449 5.59 MB/sec execute 1 sec latency 412.177 ms 2024-09-10T23:18:03.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75329 35.55 MB/sec warmup 119 sec latency 1373.731 ms 2024-09-10T23:18:04.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14519 4.58 MB/sec execute 2 sec latency 370.752 ms 2024-09-10T23:18:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:04 smithi046 ceph-mon[28128]: pgmap v729: 129 pgs: 129 active+clean; 420 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.6 MiB/s wr, 95 op/s 2024-09-10T23:18:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:04 smithi073 ceph-mon[35473]: pgmap v729: 129 pgs: 129 active+clean; 420 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.6 MiB/s wr, 95 op/s 2024-09-10T23:18:05.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14558 3.20 MB/sec execute 3 sec latency 374.790 ms 2024-09-10T23:18:05.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75340 0.04 MB/sec execute 1 sec latency 1155.238 ms 2024-09-10T23:18:06.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14611 2.76 MB/sec execute 4 sec latency 403.446 ms 2024-09-10T23:18:06.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75375 0.48 MB/sec execute 2 sec latency 1200.811 ms 2024-09-10T23:18:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:06 smithi046 ceph-mon[28128]: pgmap v730: 129 pgs: 129 active+clean; 421 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 102 op/s 2024-09-10T23:18:07.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:06 smithi073 ceph-mon[35473]: pgmap v730: 129 pgs: 129 active+clean; 421 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 102 op/s 2024-09-10T23:18:07.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14665 2.43 MB/sec execute 5 sec latency 374.952 ms 2024-09-10T23:18:07.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75377 0.32 MB/sec execute 3 sec latency 1325.584 ms 2024-09-10T23:18:08.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14743 2.22 MB/sec execute 6 sec latency 263.959 ms 2024-09-10T23:18:08.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75387 0.31 MB/sec execute 4 sec latency 1427.726 ms 2024-09-10T23:18:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:08 smithi046 ceph-mon[28128]: pgmap v731: 129 pgs: 129 active+clean; 424 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 4.1 MiB/s wr, 106 op/s 2024-09-10T23:18:09.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:08 smithi073 ceph-mon[35473]: pgmap v731: 129 pgs: 129 active+clean; 424 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 4.1 MiB/s wr, 106 op/s 2024-09-10T23:18:09.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14770 1.93 MB/sec execute 7 sec latency 468.801 ms 2024-09-10T23:18:09.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75410 0.37 MB/sec execute 5 sec latency 1326.301 ms 2024-09-10T23:18:10.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14830 1.72 MB/sec execute 8 sec latency 447.136 ms 2024-09-10T23:18:10.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75418 0.34 MB/sec execute 6 sec latency 1090.973 ms 2024-09-10T23:18:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:10 smithi046 ceph-mon[28128]: pgmap v732: 129 pgs: 129 active+clean; 426 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.3 MiB/s wr, 90 op/s 2024-09-10T23:18:11.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:10 smithi073 ceph-mon[35473]: pgmap v732: 129 pgs: 129 active+clean; 426 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.3 MiB/s wr, 90 op/s 2024-09-10T23:18:11.416 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14874 1.58 MB/sec execute 9 sec latency 475.551 ms 2024-09-10T23:18:11.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75433 0.33 MB/sec execute 7 sec latency 1266.818 ms 2024-09-10T23:18:12.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 14950 1.54 MB/sec execute 10 sec latency 405.764 ms 2024-09-10T23:18:12.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75468 0.40 MB/sec execute 8 sec latency 1052.280 ms 2024-09-10T23:18:13.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:12 smithi073 ceph-mon[35473]: pgmap v733: 129 pgs: 129 active+clean; 426 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.2 MiB/s wr, 92 op/s 2024-09-10T23:18:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:12 smithi046 ceph-mon[28128]: pgmap v733: 129 pgs: 129 active+clean; 426 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.2 MiB/s wr, 92 op/s 2024-09-10T23:18:13.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15014 1.80 MB/sec execute 11 sec latency 463.750 ms 2024-09-10T23:18:13.837 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75472 0.36 MB/sec execute 9 sec latency 1363.671 ms 2024-09-10T23:18:14.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15127 1.86 MB/sec execute 12 sec latency 294.403 ms 2024-09-10T23:18:14.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75722 2.42 MB/sec execute 10 sec latency 1092.914 ms 2024-09-10T23:18:15.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:14 smithi046 ceph-mon[28128]: pgmap v734: 129 pgs: 129 active+clean; 426 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.0 MiB/s wr, 60 op/s 2024-09-10T23:18:15.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:14 smithi073 ceph-mon[35473]: pgmap v734: 129 pgs: 129 active+clean; 426 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.0 MiB/s wr, 60 op/s 2024-09-10T23:18:15.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15193 1.87 MB/sec execute 13 sec latency 582.454 ms 2024-09-10T23:18:15.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75722 2.20 MB/sec execute 11 sec latency 1889.857 ms 2024-09-10T23:18:16.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15212 1.75 MB/sec execute 14 sec latency 1582.562 ms 2024-09-10T23:18:16.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 75722 2.02 MB/sec execute 12 sec latency 2890.005 ms 2024-09-10T23:18:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:16 smithi046 ceph-mon[28128]: pgmap v735: 129 pgs: 129 active+clean; 414 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.8 KiB/s rd, 2.2 MiB/s wr, 99 op/s 2024-09-10T23:18:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:16 smithi073 ceph-mon[35473]: pgmap v735: 129 pgs: 129 active+clean; 414 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.8 KiB/s rd, 2.2 MiB/s wr, 99 op/s 2024-09-10T23:18:17.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:17.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15274 1.73 MB/sec execute 15 sec latency 2097.333 ms 2024-09-10T23:18:17.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 76198 3.07 MB/sec execute 13 sec latency 3403.102 ms 2024-09-10T23:18:18.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:17 smithi073 ceph-mon[35473]: pgmap v736: 129 pgs: 129 active+clean; 406 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-09-10T23:18:18.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15395 2.19 MB/sec execute 16 sec latency 184.952 ms 2024-09-10T23:18:18.677 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.677 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:17 smithi046 ceph-mon[28128]: pgmap v736: 129 pgs: 129 active+clean; 406 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-09-10T23:18:18.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 76547 3.75 MB/sec execute 14 sec latency 794.323 ms 2024-09-10T23:18:19.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15494 2.28 MB/sec execute 17 sec latency 249.762 ms 2024-09-10T23:18:19.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 76747 4.36 MB/sec execute 15 sec latency 525.719 ms 2024-09-10T23:18:20.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15637 2.90 MB/sec execute 18 sec latency 152.216 ms 2024-09-10T23:18:20.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:20 smithi073 ceph-mon[35473]: pgmap v737: 129 pgs: 129 active+clean; 406 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2024-09-10T23:18:20.650 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:20 smithi046 ceph-mon[28128]: pgmap v737: 129 pgs: 129 active+clean; 406 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2024-09-10T23:18:20.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 77175 5.88 MB/sec execute 16 sec latency 703.242 ms 2024-09-10T23:18:21.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15780 3.39 MB/sec execute 19 sec latency 158.777 ms 2024-09-10T23:18:21.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 77598 7.09 MB/sec execute 17 sec latency 448.079 ms 2024-09-10T23:18:22.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 15914 3.31 MB/sec execute 20 sec latency 96.868 ms 2024-09-10T23:18:22.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:22 smithi046 ceph-mon[28128]: pgmap v738: 129 pgs: 129 active+clean; 407 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 1.7 MiB/s wr, 123 op/s 2024-09-10T23:18:22.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:22.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:22.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:22 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:18:22.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:22 smithi073 ceph-mon[35473]: pgmap v738: 129 pgs: 129 active+clean; 407 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 1.7 MiB/s wr, 123 op/s 2024-09-10T23:18:22.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:22.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:22.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:22 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:18:22.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 78613 9.96 MB/sec execute 18 sec latency 441.627 ms 2024-09-10T23:18:23.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16074 3.36 MB/sec execute 21 sec latency 103.805 ms 2024-09-10T23:18:23.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 78838 10.01 MB/sec execute 19 sec latency 641.988 ms 2024-09-10T23:18:24.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16208 3.33 MB/sec execute 22 sec latency 162.996 ms 2024-09-10T23:18:24.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:24 smithi046 ceph-mon[28128]: pgmap v739: 129 pgs: 129 active+clean; 407 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.6 MiB/s wr, 119 op/s 2024-09-10T23:18:24.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:24 smithi073 ceph-mon[35473]: pgmap v739: 129 pgs: 129 active+clean; 407 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.6 MiB/s wr, 119 op/s 2024-09-10T23:18:24.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 78910 9.60 MB/sec execute 20 sec latency 818.291 ms 2024-09-10T23:18:25.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16353 3.31 MB/sec execute 23 sec latency 267.434 ms 2024-09-10T23:18:25.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 78985 9.22 MB/sec execute 21 sec latency 773.812 ms 2024-09-10T23:18:26.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16491 3.28 MB/sec execute 24 sec latency 72.274 ms 2024-09-10T23:18:26.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:26 smithi046 ceph-mon[28128]: pgmap v740: 129 pgs: 129 active+clean; 408 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-10T23:18:26.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:26 smithi073 ceph-mon[35473]: pgmap v740: 129 pgs: 129 active+clean; 408 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-10T23:18:26.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 80198 11.30 MB/sec execute 22 sec latency 117.880 ms 2024-09-10T23:18:27.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16638 3.52 MB/sec execute 25 sec latency 91.991 ms 2024-09-10T23:18:27.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 81495 14.67 MB/sec execute 23 sec latency 137.161 ms 2024-09-10T23:18:28.417 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16734 3.56 MB/sec execute 26 sec latency 92.499 ms 2024-09-10T23:18:28.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:28 smithi046 ceph-mon[28128]: pgmap v741: 129 pgs: 129 active+clean; 411 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 MiB/s wr, 146 op/s 2024-09-10T23:18:28.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:28 smithi073 ceph-mon[35473]: pgmap v741: 129 pgs: 129 active+clean; 411 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 MiB/s wr, 146 op/s 2024-09-10T23:18:28.838 INFO:tasks.workunit.client.0.smithi046.stdout: 10 82364 15.87 MB/sec execute 24 sec latency 110.729 ms 2024-09-10T23:18:29.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 16890 3.85 MB/sec execute 27 sec latency 100.409 ms 2024-09-10T23:18:29.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 82821 16.26 MB/sec execute 25 sec latency 100.620 ms 2024-09-10T23:18:30.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17089 4.45 MB/sec execute 28 sec latency 90.565 ms 2024-09-10T23:18:30.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:30 smithi046 ceph-mon[28128]: pgmap v742: 129 pgs: 129 active+clean; 412 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-09-10T23:18:30.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:30 smithi073 ceph-mon[35473]: pgmap v742: 129 pgs: 129 active+clean; 412 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-09-10T23:18:30.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 83517 16.53 MB/sec execute 26 sec latency 471.083 ms 2024-09-10T23:18:31.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17302 4.98 MB/sec execute 29 sec latency 187.972 ms 2024-09-10T23:18:31.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 83832 16.58 MB/sec execute 27 sec latency 776.348 ms 2024-09-10T23:18:32.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17512 5.22 MB/sec execute 30 sec latency 140.297 ms 2024-09-10T23:18:32.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:32 smithi046 ceph-mon[28128]: pgmap v743: 129 pgs: 129 active+clean; 422 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.1 MiB/s wr, 160 op/s 2024-09-10T23:18:32.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:32.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:32 smithi073 ceph-mon[35473]: pgmap v743: 129 pgs: 129 active+clean; 422 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.1 MiB/s wr, 160 op/s 2024-09-10T23:18:32.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:32.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 85311 19.32 MB/sec execute 28 sec latency 142.886 ms 2024-09-10T23:18:33.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17573 5.17 MB/sec execute 31 sec latency 102.273 ms 2024-09-10T23:18:33.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 85936 19.75 MB/sec execute 29 sec latency 112.996 ms 2024-09-10T23:18:34.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17626 5.11 MB/sec execute 32 sec latency 87.771 ms 2024-09-10T23:18:34.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:34 smithi046 ceph-mon[28128]: pgmap v744: 129 pgs: 129 active+clean; 424 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2024-09-10T23:18:34.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:34 smithi073 ceph-mon[35473]: pgmap v744: 129 pgs: 129 active+clean; 424 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2024-09-10T23:18:34.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 86396 19.93 MB/sec execute 30 sec latency 113.718 ms 2024-09-10T23:18:35.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17735 5.28 MB/sec execute 33 sec latency 94.429 ms 2024-09-10T23:18:35.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 87406 20.72 MB/sec execute 31 sec latency 134.789 ms 2024-09-10T23:18:36.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17896 5.61 MB/sec execute 34 sec latency 193.349 ms 2024-09-10T23:18:36.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:36 smithi046 ceph-mon[28128]: pgmap v745: 129 pgs: 129 active+clean; 432 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.4 MiB/s wr, 138 op/s 2024-09-10T23:18:36.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:36 smithi073 ceph-mon[35473]: pgmap v745: 129 pgs: 129 active+clean; 432 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.4 MiB/s wr, 138 op/s 2024-09-10T23:18:36.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 87782 20.85 MB/sec execute 32 sec latency 818.343 ms 2024-09-10T23:18:37.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 17939 5.50 MB/sec execute 35 sec latency 544.212 ms 2024-09-10T23:18:37.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 88074 20.74 MB/sec execute 33 sec latency 1349.413 ms 2024-09-10T23:18:38.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18032 5.53 MB/sec execute 36 sec latency 457.773 ms 2024-09-10T23:18:38.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:38 smithi046 ceph-mon[28128]: pgmap v746: 129 pgs: 129 active+clean; 437 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.9 MiB/s wr, 149 op/s 2024-09-10T23:18:38.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:38 smithi073 ceph-mon[35473]: pgmap v746: 129 pgs: 129 active+clean; 437 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.9 MiB/s wr, 149 op/s 2024-09-10T23:18:38.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 88799 21.52 MB/sec execute 34 sec latency 638.544 ms 2024-09-10T23:18:39.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18112 5.46 MB/sec execute 37 sec latency 388.338 ms 2024-09-10T23:18:39.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 89012 21.16 MB/sec execute 35 sec latency 580.151 ms 2024-09-10T23:18:40.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18173 5.35 MB/sec execute 38 sec latency 317.680 ms 2024-09-10T23:18:40.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:40 smithi046 ceph-mon[28128]: pgmap v747: 129 pgs: 129 active+clean; 436 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.8 MiB/s wr, 106 op/s 2024-09-10T23:18:40.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:40 smithi073 ceph-mon[35473]: pgmap v747: 129 pgs: 129 active+clean; 436 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.8 MiB/s wr, 106 op/s 2024-09-10T23:18:40.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 89441 21.19 MB/sec execute 36 sec latency 567.770 ms 2024-09-10T23:18:41.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18256 5.32 MB/sec execute 39 sec latency 205.451 ms 2024-09-10T23:18:41.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 89485 20.65 MB/sec execute 37 sec latency 548.178 ms 2024-09-10T23:18:42.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18321 5.19 MB/sec execute 40 sec latency 375.527 ms 2024-09-10T23:18:42.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:42 smithi046 ceph-mon[28128]: pgmap v748: 129 pgs: 129 active+clean; 438 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.8 MiB/s wr, 134 op/s 2024-09-10T23:18:42.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:42 smithi073 ceph-mon[35473]: pgmap v748: 129 pgs: 129 active+clean; 438 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.8 MiB/s wr, 134 op/s 2024-09-10T23:18:42.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 89573 20.16 MB/sec execute 38 sec latency 1017.834 ms 2024-09-10T23:18:43.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18429 5.08 MB/sec execute 41 sec latency 90.499 ms 2024-09-10T23:18:43.839 INFO:tasks.workunit.client.0.smithi046.stdout: 10 90523 20.75 MB/sec execute 39 sec latency 115.104 ms 2024-09-10T23:18:44.418 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18557 5.00 MB/sec execute 42 sec latency 112.225 ms 2024-09-10T23:18:44.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:44 smithi046 ceph-mon[28128]: pgmap v749: 129 pgs: 129 active+clean; 438 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 85 op/s 2024-09-10T23:18:44.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:44 smithi073 ceph-mon[35473]: pgmap v749: 129 pgs: 129 active+clean; 438 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 85 op/s 2024-09-10T23:18:44.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 91772 22.14 MB/sec execute 40 sec latency 127.794 ms 2024-09-10T23:18:45.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18698 4.98 MB/sec execute 43 sec latency 110.178 ms 2024-09-10T23:18:45.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 92823 23.10 MB/sec execute 41 sec latency 140.200 ms 2024-09-10T23:18:46.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18825 4.95 MB/sec execute 44 sec latency 105.075 ms 2024-09-10T23:18:46.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:46 smithi046 ceph-mon[28128]: pgmap v750: 129 pgs: 129 active+clean; 441 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 119 op/s 2024-09-10T23:18:46.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:46 smithi073 ceph-mon[35473]: pgmap v750: 129 pgs: 129 active+clean; 441 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 119 op/s 2024-09-10T23:18:46.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 93102 22.79 MB/sec execute 42 sec latency 116.834 ms 2024-09-10T23:18:47.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 18967 5.00 MB/sec execute 45 sec latency 105.560 ms 2024-09-10T23:18:47.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:47 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:47.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:47 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:18:47.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 93887 23.15 MB/sec execute 43 sec latency 152.953 ms 2024-09-10T23:18:48.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19111 5.03 MB/sec execute 46 sec latency 93.071 ms 2024-09-10T23:18:48.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:48 smithi046 ceph-mon[28128]: pgmap v751: 129 pgs: 129 active+clean; 438 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2024-09-10T23:18:48.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:48 smithi073 ceph-mon[35473]: pgmap v751: 129 pgs: 129 active+clean; 438 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2024-09-10T23:18:48.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 95027 24.00 MB/sec execute 44 sec latency 150.260 ms 2024-09-10T23:18:49.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19267 5.31 MB/sec execute 47 sec latency 93.418 ms 2024-09-10T23:18:49.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 96326 25.22 MB/sec execute 45 sec latency 126.677 ms 2024-09-10T23:18:50.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19410 5.36 MB/sec execute 48 sec latency 83.661 ms 2024-09-10T23:18:50.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:50 smithi046 ceph-mon[28128]: pgmap v752: 129 pgs: 129 active+clean; 437 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 112 op/s 2024-09-10T23:18:50.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:50 smithi073 ceph-mon[35473]: pgmap v752: 129 pgs: 129 active+clean; 437 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 112 op/s 2024-09-10T23:18:50.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 96597 24.93 MB/sec execute 46 sec latency 162.126 ms 2024-09-10T23:18:51.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19530 5.32 MB/sec execute 49 sec latency 181.053 ms 2024-09-10T23:18:51.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 96625 24.42 MB/sec execute 47 sec latency 962.762 ms 2024-09-10T23:18:52.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19678 5.27 MB/sec execute 50 sec latency 296.151 ms 2024-09-10T23:18:52.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:52 smithi046 ceph-mon[28128]: pgmap v753: 129 pgs: 129 active+clean; 422 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.0 MiB/s wr, 158 op/s 2024-09-10T23:18:52.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:52 smithi073 ceph-mon[35473]: pgmap v753: 129 pgs: 129 active+clean; 422 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.0 MiB/s wr, 158 op/s 2024-09-10T23:18:52.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 96850 24.14 MB/sec execute 48 sec latency 561.507 ms 2024-09-10T23:18:53.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19798 5.20 MB/sec execute 51 sec latency 191.583 ms 2024-09-10T23:18:53.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 96884 23.66 MB/sec execute 49 sec latency 1228.089 ms 2024-09-10T23:18:54.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19859 5.13 MB/sec execute 52 sec latency 477.728 ms 2024-09-10T23:18:54.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:54 smithi046 ceph-mon[28128]: pgmap v754: 129 pgs: 129 active+clean; 424 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.4 KiB/s rd, 2.2 MiB/s wr, 153 op/s 2024-09-10T23:18:54.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:54 smithi073 ceph-mon[35473]: pgmap v754: 129 pgs: 129 active+clean; 424 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.4 KiB/s rd, 2.2 MiB/s wr, 153 op/s 2024-09-10T23:18:54.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97086 23.52 MB/sec execute 50 sec latency 1320.290 ms 2024-09-10T23:18:55.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 19940 5.07 MB/sec execute 53 sec latency 536.046 ms 2024-09-10T23:18:55.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97154 23.07 MB/sec execute 51 sec latency 1501.198 ms 2024-09-10T23:18:56.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20000 4.99 MB/sec execute 54 sec latency 374.998 ms 2024-09-10T23:18:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:56 smithi046 ceph-mon[28128]: pgmap v755: 129 pgs: 129 active+clean; 425 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.2 MiB/s wr, 170 op/s 2024-09-10T23:18:56.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:56 smithi073 ceph-mon[35473]: pgmap v755: 129 pgs: 129 active+clean; 425 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.2 MiB/s wr, 170 op/s 2024-09-10T23:18:56.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97218 22.64 MB/sec execute 52 sec latency 1402.260 ms 2024-09-10T23:18:57.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20106 4.96 MB/sec execute 55 sec latency 393.223 ms 2024-09-10T23:18:57.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97225 22.21 MB/sec execute 53 sec latency 1451.040 ms 2024-09-10T23:18:58.419 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20205 4.97 MB/sec execute 56 sec latency 375.573 ms 2024-09-10T23:18:58.795 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:18:58 smithi046 ceph-mon[28128]: pgmap v756: 129 pgs: 129 active+clean; 427 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-10T23:18:58.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:18:58 smithi073 ceph-mon[35473]: pgmap v756: 129 pgs: 129 active+clean; 427 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-10T23:18:58.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97330 21.82 MB/sec execute 54 sec latency 1435.032 ms 2024-09-10T23:18:59.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20261 4.93 MB/sec execute 57 sec latency 441.978 ms 2024-09-10T23:18:59.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97428 21.58 MB/sec execute 55 sec latency 1158.638 ms 2024-09-10T23:19:00.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20315 4.92 MB/sec execute 58 sec latency 371.317 ms 2024-09-10T23:19:00.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:00 smithi046 ceph-mon[28128]: pgmap v757: 129 pgs: 129 active+clean; 428 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.9 MiB/s wr, 136 op/s 2024-09-10T23:19:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:00 smithi073 ceph-mon[35473]: pgmap v757: 129 pgs: 129 active+clean; 428 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.9 MiB/s wr, 136 op/s 2024-09-10T23:19:00.840 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97546 21.25 MB/sec execute 56 sec latency 1549.821 ms 2024-09-10T23:19:01.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20378 4.92 MB/sec execute 59 sec latency 492.450 ms 2024-09-10T23:19:01.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 97569 20.88 MB/sec execute 57 sec latency 1602.712 ms 2024-09-10T23:19:02.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20487 4.95 MB/sec execute 60 sec latency 326.749 ms 2024-09-10T23:19:02.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:02 smithi046 ceph-mon[28128]: pgmap v758: 129 pgs: 129 active+clean; 430 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.4 MiB/s wr, 148 op/s 2024-09-10T23:19:02.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:02.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:02 smithi073 ceph-mon[35473]: pgmap v758: 129 pgs: 129 active+clean; 430 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.4 MiB/s wr, 148 op/s 2024-09-10T23:19:02.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:02.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 98574 21.50 MB/sec execute 58 sec latency 1143.664 ms 2024-09-10T23:19:03.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20683 5.24 MB/sec execute 61 sec latency 94.852 ms 2024-09-10T23:19:03.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 99859 22.48 MB/sec execute 59 sec latency 148.316 ms 2024-09-10T23:19:04.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 20901 5.41 MB/sec execute 62 sec latency 118.147 ms 2024-09-10T23:19:04.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:04 smithi046 ceph-mon[28128]: pgmap v759: 129 pgs: 129 active+clean; 430 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.7 MiB/s wr, 100 op/s 2024-09-10T23:19:04.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:04 smithi073 ceph-mon[35473]: pgmap v759: 129 pgs: 129 active+clean; 430 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.7 MiB/s wr, 100 op/s 2024-09-10T23:19:04.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 100148 22.31 MB/sec execute 60 sec latency 117.346 ms 2024-09-10T23:19:05.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21104 5.53 MB/sec execute 63 sec latency 100.034 ms 2024-09-10T23:19:05.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 100762 22.44 MB/sec execute 61 sec latency 143.695 ms 2024-09-10T23:19:06.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21177 5.50 MB/sec execute 64 sec latency 88.476 ms 2024-09-10T23:19:06.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:06 smithi046 ceph-mon[28128]: pgmap v760: 129 pgs: 129 active+clean; 440 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.4 MiB/s wr, 98 op/s 2024-09-10T23:19:06.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:06 smithi073 ceph-mon[35473]: pgmap v760: 129 pgs: 129 active+clean; 440 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.4 MiB/s wr, 98 op/s 2024-09-10T23:19:06.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 101876 23.02 MB/sec execute 62 sec latency 142.222 ms 2024-09-10T23:19:07.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21235 5.47 MB/sec execute 65 sec latency 89.185 ms 2024-09-10T23:19:07.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 102600 23.40 MB/sec execute 63 sec latency 307.734 ms 2024-09-10T23:19:08.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21335 5.51 MB/sec execute 66 sec latency 88.866 ms 2024-09-10T23:19:08.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:08 smithi046 ceph-mon[28128]: pgmap v761: 129 pgs: 129 active+clean; 449 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.1 MiB/s wr, 90 op/s 2024-09-10T23:19:08.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:08 smithi073 ceph-mon[35473]: pgmap v761: 129 pgs: 129 active+clean; 449 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.1 MiB/s wr, 90 op/s 2024-09-10T23:19:08.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 103625 23.87 MB/sec execute 64 sec latency 150.070 ms 2024-09-10T23:19:09.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21499 5.70 MB/sec execute 67 sec latency 92.290 ms 2024-09-10T23:19:09.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 103765 23.56 MB/sec execute 65 sec latency 129.470 ms 2024-09-10T23:19:10.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21648 5.76 MB/sec execute 68 sec latency 96.077 ms 2024-09-10T23:19:10.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:10 smithi046 ceph-mon[28128]: pgmap v762: 129 pgs: 129 active+clean; 450 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.2 MiB/s wr, 84 op/s 2024-09-10T23:19:10.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:10 smithi073 ceph-mon[35473]: pgmap v762: 129 pgs: 129 active+clean; 450 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.2 MiB/s wr, 84 op/s 2024-09-10T23:19:10.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 104324 23.64 MB/sec execute 66 sec latency 391.380 ms 2024-09-10T23:19:11.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21727 5.72 MB/sec execute 69 sec latency 301.988 ms 2024-09-10T23:19:11.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 104476 23.36 MB/sec execute 67 sec latency 836.639 ms 2024-09-10T23:19:12.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21793 5.69 MB/sec execute 70 sec latency 408.637 ms 2024-09-10T23:19:12.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:12 smithi046 ceph-mon[28128]: pgmap v763: 129 pgs: 129 active+clean; 452 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 4.1 MiB/s wr, 111 op/s 2024-09-10T23:19:12.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:12 smithi073 ceph-mon[35473]: pgmap v763: 129 pgs: 129 active+clean; 452 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 4.1 MiB/s wr, 111 op/s 2024-09-10T23:19:12.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 105563 23.91 MB/sec execute 68 sec latency 716.634 ms 2024-09-10T23:19:13.420 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21885 5.63 MB/sec execute 71 sec latency 94.891 ms 2024-09-10T23:19:13.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 106848 24.67 MB/sec execute 69 sec latency 132.844 ms 2024-09-10T23:19:14.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 21984 5.56 MB/sec execute 72 sec latency 102.409 ms 2024-09-10T23:19:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:14 smithi046 ceph-mon[28128]: pgmap v764: 129 pgs: 129 active+clean; 452 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.5 MiB/s wr, 94 op/s 2024-09-10T23:19:14.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:14 smithi073 ceph-mon[35473]: pgmap v764: 129 pgs: 129 active+clean; 452 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.5 MiB/s wr, 94 op/s 2024-09-10T23:19:14.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 107236 24.58 MB/sec execute 70 sec latency 116.435 ms 2024-09-10T23:19:15.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22100 5.50 MB/sec execute 73 sec latency 184.078 ms 2024-09-10T23:19:15.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 107826 24.66 MB/sec execute 71 sec latency 114.745 ms 2024-09-10T23:19:16.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22232 5.47 MB/sec execute 74 sec latency 122.911 ms 2024-09-10T23:19:16.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:16 smithi046 ceph-mon[28128]: pgmap v765: 129 pgs: 129 active+clean; 448 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 118 op/s 2024-09-10T23:19:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:16 smithi073 ceph-mon[35473]: pgmap v765: 129 pgs: 129 active+clean; 448 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 118 op/s 2024-09-10T23:19:16.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 108546 24.68 MB/sec execute 72 sec latency 370.622 ms 2024-09-10T23:19:17.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22350 5.43 MB/sec execute 75 sec latency 192.303 ms 2024-09-10T23:19:17.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:17.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:17.841 INFO:tasks.workunit.client.0.smithi046.stdout: 10 109098 24.89 MB/sec execute 73 sec latency 1059.255 ms 2024-09-10T23:19:18.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22478 5.44 MB/sec execute 76 sec latency 250.952 ms 2024-09-10T23:19:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:18 smithi046 ceph-mon[28128]: pgmap v766: 129 pgs: 129 active+clean; 431 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.4 MiB/s wr, 113 op/s 2024-09-10T23:19:18.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:18 smithi073 ceph-mon[35473]: pgmap v766: 129 pgs: 129 active+clean; 431 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.4 MiB/s wr, 113 op/s 2024-09-10T23:19:18.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 110375 25.58 MB/sec execute 74 sec latency 155.979 ms 2024-09-10T23:19:19.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22589 5.47 MB/sec execute 77 sec latency 294.944 ms 2024-09-10T23:19:19.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 110487 25.31 MB/sec execute 75 sec latency 844.249 ms 2024-09-10T23:19:20.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22710 5.50 MB/sec execute 78 sec latency 236.506 ms 2024-09-10T23:19:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:20 smithi046 ceph-mon[28128]: pgmap v767: 129 pgs: 129 active+clean; 426 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 114 op/s 2024-09-10T23:19:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:20 smithi073 ceph-mon[35473]: pgmap v767: 129 pgs: 129 active+clean; 426 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 114 op/s 2024-09-10T23:19:20.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 110795 25.16 MB/sec execute 76 sec latency 897.597 ms 2024-09-10T23:19:21.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 22876 5.60 MB/sec execute 79 sec latency 72.423 ms 2024-09-10T23:19:21.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 111613 25.35 MB/sec execute 77 sec latency 115.691 ms 2024-09-10T23:19:22.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23028 5.65 MB/sec execute 80 sec latency 80.210 ms 2024-09-10T23:19:22.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:22 smithi046 ceph-mon[28128]: pgmap v768: 129 pgs: 129 active+clean; 415 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.4 KiB/s rd, 3.5 MiB/s wr, 173 op/s 2024-09-10T23:19:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:22 smithi073 ceph-mon[35473]: pgmap v768: 129 pgs: 129 active+clean; 415 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.4 KiB/s rd, 3.5 MiB/s wr, 173 op/s 2024-09-10T23:19:22.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 112839 25.91 MB/sec execute 78 sec latency 134.991 ms 2024-09-10T23:19:23.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23182 5.61 MB/sec execute 81 sec latency 87.963 ms 2024-09-10T23:19:23.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114028 26.45 MB/sec execute 79 sec latency 136.478 ms 2024-09-10T23:19:24.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23335 5.58 MB/sec execute 82 sec latency 88.919 ms 2024-09-10T23:19:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:24 smithi046 ceph-mon[28128]: pgmap v769: 129 pgs: 129 active+clean; 413 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2024-09-10T23:19:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:24 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:24 smithi073 ceph-mon[35473]: pgmap v769: 129 pgs: 129 active+clean; 413 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2024-09-10T23:19:24.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:24 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:24.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114168 26.21 MB/sec execute 80 sec latency 706.284 ms 2024-09-10T23:19:25.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23433 5.52 MB/sec execute 83 sec latency 371.683 ms 2024-09-10T23:19:25.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114271 25.95 MB/sec execute 81 sec latency 1050.381 ms 2024-09-10T23:19:26.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23525 5.49 MB/sec execute 84 sec latency 354.474 ms 2024-09-10T23:19:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:26 smithi046 ceph-mon[28128]: pgmap v770: 129 pgs: 129 active+clean; 416 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-09-10T23:19:26.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:26 smithi073 ceph-mon[35473]: pgmap v770: 129 pgs: 129 active+clean; 416 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-09-10T23:19:26.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114287 25.64 MB/sec execute 82 sec latency 1073.615 ms 2024-09-10T23:19:27.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23629 5.45 MB/sec execute 85 sec latency 357.424 ms 2024-09-10T23:19:27.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114334 25.34 MB/sec execute 83 sec latency 981.415 ms 2024-09-10T23:19:28.421 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23726 5.44 MB/sec execute 86 sec latency 534.892 ms 2024-09-10T23:19:28.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:28 smithi046 ceph-mon[28128]: pgmap v771: 129 pgs: 129 active+clean; 418 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 173 op/s 2024-09-10T23:19:28.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:28 smithi073 ceph-mon[35473]: pgmap v771: 129 pgs: 129 active+clean; 418 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 173 op/s 2024-09-10T23:19:28.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114356 25.05 MB/sec execute 84 sec latency 807.835 ms 2024-09-10T23:19:29.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23820 5.45 MB/sec execute 87 sec latency 333.523 ms 2024-09-10T23:19:29.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:29.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:19:29.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:29.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:19:29.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 115314 25.25 MB/sec execute 85 sec latency 812.239 ms 2024-09-10T23:19:30.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 23959 5.50 MB/sec execute 88 sec latency 87.662 ms 2024-09-10T23:19:30.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 116538 25.81 MB/sec execute 86 sec latency 123.856 ms 2024-09-10T23:19:30.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:30 smithi073 ceph-mon[35473]: pgmap v772: 129 pgs: 129 active+clean; 418 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-09-10T23:19:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:30 smithi046 ceph-mon[28128]: pgmap v772: 129 pgs: 129 active+clean; 418 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-09-10T23:19:31.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24104 5.56 MB/sec execute 89 sec latency 95.160 ms 2024-09-10T23:19:31.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 117620 26.24 MB/sec execute 87 sec latency 109.540 ms 2024-09-10T23:19:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:32.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24319 5.73 MB/sec execute 90 sec latency 77.369 ms 2024-09-10T23:19:32.842 INFO:tasks.workunit.client.0.smithi046.stdout: 10 117931 26.09 MB/sec execute 88 sec latency 107.096 ms 2024-09-10T23:19:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:32 smithi046 ceph-mon[28128]: pgmap v773: 129 pgs: 129 active+clean; 423 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 184 op/s 2024-09-10T23:19:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:32 smithi073 ceph-mon[35473]: pgmap v773: 129 pgs: 129 active+clean; 423 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 184 op/s 2024-09-10T23:19:33.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24551 5.86 MB/sec execute 91 sec latency 80.739 ms 2024-09-10T23:19:33.843 INFO:tasks.workunit.client.0.smithi046.stdout: 10 118796 26.25 MB/sec execute 89 sec latency 183.088 ms 2024-09-10T23:19:34.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24683 5.88 MB/sec execute 92 sec latency 129.288 ms 2024-09-10T23:19:34.843 INFO:tasks.workunit.client.0.smithi046.stdout: 10 118892 25.98 MB/sec execute 90 sec latency 939.524 ms 2024-09-10T23:19:34.970 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:34 smithi046 ceph-mon[28128]: pgmap v774: 129 pgs: 129 active+clean; 424 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 2.0 MiB/s wr, 113 op/s 2024-09-10T23:19:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:34 smithi073 ceph-mon[35473]: pgmap v774: 129 pgs: 129 active+clean; 424 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 2.0 MiB/s wr, 113 op/s 2024-09-10T23:19:35.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24708 5.83 MB/sec execute 93 sec latency 452.363 ms 2024-09-10T23:19:35.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 118900 25.69 MB/sec execute 91 sec latency 1359.506 ms 2024-09-10T23:19:36.422 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24750 5.81 MB/sec execute 94 sec latency 484.070 ms 2024-09-10T23:19:36.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119043 25.47 MB/sec execute 92 sec latency 1384.238 ms 2024-09-10T23:19:37.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:36 smithi046 ceph-mon[28128]: pgmap v775: 129 pgs: 129 active+clean; 434 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2024-09-10T23:19:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:36 smithi073 ceph-mon[35473]: pgmap v775: 129 pgs: 129 active+clean; 434 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2024-09-10T23:19:37.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24770 5.76 MB/sec execute 95 sec latency 371.776 ms 2024-09-10T23:19:37.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119115 25.25 MB/sec execute 93 sec latency 1323.482 ms 2024-09-10T23:19:38.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24805 5.70 MB/sec execute 96 sec latency 531.144 ms 2024-09-10T23:19:38.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119385 25.15 MB/sec execute 94 sec latency 1396.602 ms 2024-09-10T23:19:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:38 smithi046 ceph-mon[28128]: pgmap v776: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 KiB/s rd, 3.3 MiB/s wr, 103 op/s 2024-09-10T23:19:39.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:38 smithi073 ceph-mon[35473]: pgmap v776: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 KiB/s rd, 3.3 MiB/s wr, 103 op/s 2024-09-10T23:19:39.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 24867 5.72 MB/sec execute 97 sec latency 305.090 ms 2024-09-10T23:19:39.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119403 24.89 MB/sec execute 95 sec latency 1116.227 ms 2024-09-10T23:19:40.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25006 5.80 MB/sec execute 98 sec latency 430.708 ms 2024-09-10T23:19:40.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119403 24.63 MB/sec execute 96 sec latency 2116.278 ms 2024-09-10T23:19:40.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:40 smithi073 ceph-mon[35473]: pgmap v777: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 KiB/s rd, 3.2 MiB/s wr, 90 op/s 2024-09-10T23:19:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:40 smithi046 ceph-mon[28128]: pgmap v777: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 KiB/s rd, 3.2 MiB/s wr, 90 op/s 2024-09-10T23:19:41.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25139 5.85 MB/sec execute 99 sec latency 179.575 ms 2024-09-10T23:19:41.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119459 24.43 MB/sec execute 97 sec latency 2557.993 ms 2024-09-10T23:19:42.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25206 5.83 MB/sec execute 100 sec latency 436.553 ms 2024-09-10T23:19:42.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119464 24.18 MB/sec execute 98 sec latency 2429.344 ms 2024-09-10T23:19:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:42 smithi046 ceph-mon[28128]: pgmap v778: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.9 MiB/s wr, 119 op/s 2024-09-10T23:19:43.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:42 smithi073 ceph-mon[35473]: pgmap v778: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.9 MiB/s wr, 119 op/s 2024-09-10T23:19:43.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25264 5.81 MB/sec execute 101 sec latency 463.430 ms 2024-09-10T23:19:43.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119626 24.05 MB/sec execute 99 sec latency 1120.877 ms 2024-09-10T23:19:44.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25338 5.78 MB/sec execute 102 sec latency 364.295 ms 2024-09-10T23:19:44.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119688 23.87 MB/sec execute 100 sec latency 1253.974 ms 2024-09-10T23:19:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:44 smithi046 ceph-mon[28128]: pgmap v779: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 80 op/s 2024-09-10T23:19:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:44 smithi073 ceph-mon[35473]: pgmap v779: 129 pgs: 129 active+clean; 442 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 80 op/s 2024-09-10T23:19:45.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25430 5.73 MB/sec execute 103 sec latency 109.530 ms 2024-09-10T23:19:45.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 120196 23.93 MB/sec execute 101 sec latency 1813.933 ms 2024-09-10T23:19:46.423 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25527 5.69 MB/sec execute 104 sec latency 135.649 ms 2024-09-10T23:19:46.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 121358 24.35 MB/sec execute 102 sec latency 111.258 ms 2024-09-10T23:19:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:46 smithi046 ceph-mon[28128]: pgmap v780: 129 pgs: 129 active+clean; 444 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 86 op/s 2024-09-10T23:19:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:46 smithi073 ceph-mon[35473]: pgmap v780: 129 pgs: 129 active+clean; 444 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 86 op/s 2024-09-10T23:19:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:19:47.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25642 5.64 MB/sec execute 105 sec latency 90.643 ms 2024-09-10T23:19:47.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 121519 24.16 MB/sec execute 103 sec latency 149.003 ms 2024-09-10T23:19:48.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25786 5.62 MB/sec execute 106 sec latency 88.153 ms 2024-09-10T23:19:48.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 122416 24.32 MB/sec execute 104 sec latency 186.267 ms 2024-09-10T23:19:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:48 smithi046 ceph-mon[28128]: pgmap v781: 129 pgs: 129 active+clean; 447 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 82 op/s 2024-09-10T23:19:49.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:48 smithi073 ceph-mon[35473]: pgmap v781: 129 pgs: 129 active+clean; 447 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 82 op/s 2024-09-10T23:19:49.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 25913 5.60 MB/sec execute 107 sec latency 106.549 ms 2024-09-10T23:19:49.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 123258 24.58 MB/sec execute 105 sec latency 413.283 ms 2024-09-10T23:19:50.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26013 5.59 MB/sec execute 108 sec latency 249.217 ms 2024-09-10T23:19:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:50 smithi046 ceph-mon[28128]: pgmap v782: 129 pgs: 129 active+clean; 446 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.3 MiB/s wr, 80 op/s 2024-09-10T23:19:50.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 123389 24.44 MB/sec execute 106 sec latency 1041.923 ms 2024-09-10T23:19:50.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:50 smithi073 ceph-mon[35473]: pgmap v782: 129 pgs: 129 active+clean; 446 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.3 MiB/s wr, 80 op/s 2024-09-10T23:19:51.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26083 5.60 MB/sec execute 109 sec latency 514.664 ms 2024-09-10T23:19:51.844 INFO:tasks.workunit.client.0.smithi046.stdout: 10 123391 24.21 MB/sec execute 107 sec latency 1105.276 ms 2024-09-10T23:19:52.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26136 5.56 MB/sec execute 110 sec latency 446.529 ms 2024-09-10T23:19:52.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 124018 24.33 MB/sec execute 108 sec latency 1373.121 ms 2024-09-10T23:19:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:52 smithi046 ceph-mon[28128]: pgmap v783: 129 pgs: 129 active+clean; 435 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.8 MiB/s wr, 145 op/s 2024-09-10T23:19:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:52 smithi073 ceph-mon[35473]: pgmap v783: 129 pgs: 129 active+clean; 435 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.8 MiB/s wr, 145 op/s 2024-09-10T23:19:53.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26282 5.60 MB/sec execute 111 sec latency 292.998 ms 2024-09-10T23:19:53.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 124925 24.55 MB/sec execute 109 sec latency 118.777 ms 2024-09-10T23:19:54.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26445 5.66 MB/sec execute 112 sec latency 73.453 ms 2024-09-10T23:19:54.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 125254 24.45 MB/sec execute 110 sec latency 184.274 ms 2024-09-10T23:19:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:54 smithi046 ceph-mon[28128]: pgmap v784: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.1 MiB/s wr, 115 op/s 2024-09-10T23:19:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:54 smithi073 ceph-mon[35473]: pgmap v784: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.1 MiB/s wr, 115 op/s 2024-09-10T23:19:55.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26599 5.71 MB/sec execute 113 sec latency 86.492 ms 2024-09-10T23:19:55.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 126630 24.85 MB/sec execute 111 sec latency 128.257 ms 2024-09-10T23:19:56.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26755 5.67 MB/sec execute 114 sec latency 76.304 ms 2024-09-10T23:19:56.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 128051 25.46 MB/sec execute 112 sec latency 118.798 ms 2024-09-10T23:19:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:56 smithi046 ceph-mon[28128]: pgmap v785: 129 pgs: 129 active+clean; 431 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 KiB/s rd, 2.6 MiB/s wr, 154 op/s 2024-09-10T23:19:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:56 smithi073 ceph-mon[35473]: pgmap v785: 129 pgs: 129 active+clean; 431 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 KiB/s rd, 2.6 MiB/s wr, 154 op/s 2024-09-10T23:19:57.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26900 5.64 MB/sec execute 115 sec latency 75.821 ms 2024-09-10T23:19:57.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 128455 25.37 MB/sec execute 113 sec latency 411.861 ms 2024-09-10T23:19:58.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 26981 5.61 MB/sec execute 116 sec latency 406.862 ms 2024-09-10T23:19:58.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 128466 25.15 MB/sec execute 114 sec latency 1253.708 ms 2024-09-10T23:19:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:19:58 smithi046 ceph-mon[28128]: pgmap v786: 129 pgs: 129 active+clean; 431 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 2.6 MiB/s wr, 159 op/s 2024-09-10T23:19:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:19:58 smithi073 ceph-mon[35473]: pgmap v786: 129 pgs: 129 active+clean; 431 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 2.6 MiB/s wr, 159 op/s 2024-09-10T23:19:59.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27050 5.57 MB/sec execute 117 sec latency 432.878 ms 2024-09-10T23:19:59.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 128468 24.93 MB/sec execute 115 sec latency 1350.633 ms 2024-09-10T23:20:00.424 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27141 5.54 MB/sec execute 118 sec latency 323.465 ms 2024-09-10T23:20:00.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 128563 24.73 MB/sec execute 116 sec latency 1046.492 ms 2024-09-10T23:20:00.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:00 smithi073 ceph-mon[35473]: pgmap v787: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 2.0 MiB/s wr, 138 op/s 2024-09-10T23:20:00.974 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:00 smithi073 ceph-mon[35473]: overall HEALTH_OK 2024-09-10T23:20:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:00 smithi046 ceph-mon[28128]: pgmap v787: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 2.0 MiB/s wr, 138 op/s 2024-09-10T23:20:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:00 smithi046 ceph-mon[28128]: overall HEALTH_OK 2024-09-10T23:20:01.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27303 5.58 MB/sec execute 119 sec latency 89.596 ms 2024-09-10T23:20:01.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 129634 24.92 MB/sec execute 117 sec latency 121.130 ms 2024-09-10T23:20:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:02.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27442 5.60 MB/sec execute 120 sec latency 75.775 ms 2024-09-10T23:20:02.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 130778 25.31 MB/sec execute 118 sec latency 130.240 ms 2024-09-10T23:20:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:02 smithi046 ceph-mon[28128]: pgmap v788: 129 pgs: 129 active+clean; 434 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.6 KiB/s rd, 2.3 MiB/s wr, 174 op/s 2024-09-10T23:20:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:02 smithi073 ceph-mon[35473]: pgmap v788: 129 pgs: 129 active+clean; 434 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.6 KiB/s rd, 2.3 MiB/s wr, 174 op/s 2024-09-10T23:20:03.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27567 5.63 MB/sec execute 121 sec latency 84.242 ms 2024-09-10T23:20:03.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 131804 25.61 MB/sec execute 119 sec latency 139.032 ms 2024-09-10T23:20:04.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27738 5.69 MB/sec execute 122 sec latency 101.831 ms 2024-09-10T23:20:04.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 132140 25.51 MB/sec execute 120 sec latency 167.504 ms 2024-09-10T23:20:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:04 smithi046 ceph-mon[28128]: pgmap v789: 129 pgs: 129 active+clean; 434 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-09-10T23:20:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:04 smithi073 ceph-mon[35473]: pgmap v789: 129 pgs: 129 active+clean; 434 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-09-10T23:20:05.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 27949 5.80 MB/sec execute 123 sec latency 96.763 ms 2024-09-10T23:20:05.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 132334 25.38 MB/sec execute 121 sec latency 736.428 ms 2024-09-10T23:20:06.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28013 5.80 MB/sec execute 124 sec latency 454.159 ms 2024-09-10T23:20:06.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 132447 25.24 MB/sec execute 122 sec latency 1361.691 ms 2024-09-10T23:20:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:06 smithi046 ceph-mon[28128]: pgmap v790: 129 pgs: 129 active+clean; 442 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 143 op/s 2024-09-10T23:20:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:06 smithi073 ceph-mon[35473]: pgmap v790: 129 pgs: 129 active+clean; 442 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 143 op/s 2024-09-10T23:20:07.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28132 5.80 MB/sec execute 125 sec latency 494.754 ms 2024-09-10T23:20:07.845 INFO:tasks.workunit.client.0.smithi046.stdout: 10 132515 25.04 MB/sec execute 123 sec latency 1068.034 ms 2024-09-10T23:20:08.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28188 5.80 MB/sec execute 126 sec latency 396.347 ms 2024-09-10T23:20:08.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 133706 25.33 MB/sec execute 124 sec latency 1159.717 ms 2024-09-10T23:20:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:08 smithi046 ceph-mon[28128]: pgmap v791: 129 pgs: 129 active+clean; 449 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.0 MiB/s wr, 117 op/s 2024-09-10T23:20:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:08 smithi073 ceph-mon[35473]: pgmap v791: 129 pgs: 129 active+clean; 449 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.0 MiB/s wr, 117 op/s 2024-09-10T23:20:09.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28300 5.81 MB/sec execute 127 sec latency 99.944 ms 2024-09-10T23:20:09.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 134768 25.69 MB/sec execute 125 sec latency 168.017 ms 2024-09-10T23:20:10.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28351 5.77 MB/sec execute 128 sec latency 99.447 ms 2024-09-10T23:20:10.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 135561 25.79 MB/sec execute 126 sec latency 175.880 ms 2024-09-10T23:20:10.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:10 smithi073 ceph-mon[35473]: pgmap v792: 129 pgs: 129 active+clean; 453 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.0 MiB/s wr, 122 op/s 2024-09-10T23:20:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:10 smithi046 ceph-mon[28128]: pgmap v792: 129 pgs: 129 active+clean; 453 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.0 MiB/s wr, 122 op/s 2024-09-10T23:20:11.425 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28471 5.82 MB/sec execute 129 sec latency 96.217 ms 2024-09-10T23:20:11.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 135937 25.71 MB/sec execute 127 sec latency 103.711 ms 2024-09-10T23:20:12.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28622 5.87 MB/sec execute 130 sec latency 88.339 ms 2024-09-10T23:20:12.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 137150 25.98 MB/sec execute 128 sec latency 118.280 ms 2024-09-10T23:20:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:12 smithi046 ceph-mon[28128]: pgmap v793: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.4 MiB/s wr, 128 op/s 2024-09-10T23:20:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:12 smithi073 ceph-mon[35473]: pgmap v793: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.4 MiB/s wr, 128 op/s 2024-09-10T23:20:13.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28766 5.93 MB/sec execute 131 sec latency 92.002 ms 2024-09-10T23:20:13.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 138391 26.38 MB/sec execute 129 sec latency 135.968 ms 2024-09-10T23:20:14.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28874 5.91 MB/sec execute 132 sec latency 99.650 ms 2024-09-10T23:20:14.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 139136 26.47 MB/sec execute 130 sec latency 118.239 ms 2024-09-10T23:20:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:14 smithi046 ceph-mon[28128]: pgmap v794: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.2 MiB/s wr, 88 op/s 2024-09-10T23:20:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:14 smithi073 ceph-mon[35473]: pgmap v794: 129 pgs: 129 active+clean; 432 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.2 MiB/s wr, 88 op/s 2024-09-10T23:20:15.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 28966 5.88 MB/sec execute 133 sec latency 90.898 ms 2024-09-10T23:20:15.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 139731 26.50 MB/sec execute 131 sec latency 156.395 ms 2024-09-10T23:20:16.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29071 5.84 MB/sec execute 134 sec latency 129.014 ms 2024-09-10T23:20:16.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 140967 26.78 MB/sec execute 132 sec latency 121.986 ms 2024-09-10T23:20:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:16 smithi046 ceph-mon[28128]: pgmap v795: 129 pgs: 129 active+clean; 434 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 114 op/s 2024-09-10T23:20:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:16 smithi073 ceph-mon[35473]: pgmap v795: 129 pgs: 129 active+clean; 434 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 114 op/s 2024-09-10T23:20:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:17.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29184 5.81 MB/sec execute 135 sec latency 140.636 ms 2024-09-10T23:20:17.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 142345 27.19 MB/sec execute 133 sec latency 147.022 ms 2024-09-10T23:20:18.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29303 5.79 MB/sec execute 136 sec latency 152.257 ms 2024-09-10T23:20:18.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 142697 27.11 MB/sec execute 134 sec latency 127.168 ms 2024-09-10T23:20:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:18 smithi046 ceph-mon[28128]: pgmap v796: 129 pgs: 129 active+clean; 439 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.9 MiB/s wr, 114 op/s 2024-09-10T23:20:19.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:18 smithi073 ceph-mon[35473]: pgmap v796: 129 pgs: 129 active+clean; 439 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.9 MiB/s wr, 114 op/s 2024-09-10T23:20:19.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29445 5.77 MB/sec execute 137 sec latency 107.987 ms 2024-09-10T23:20:19.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 143290 27.13 MB/sec execute 135 sec latency 129.304 ms 2024-09-10T23:20:20.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29580 5.79 MB/sec execute 138 sec latency 109.731 ms 2024-09-10T23:20:20.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 144186 27.23 MB/sec execute 136 sec latency 376.873 ms 2024-09-10T23:20:20.974 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:20 smithi073 ceph-mon[35473]: pgmap v797: 129 pgs: 129 active+clean; 436 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.1 MiB/s wr, 106 op/s 2024-09-10T23:20:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:20 smithi046 ceph-mon[28128]: pgmap v797: 129 pgs: 129 active+clean; 436 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.1 MiB/s wr, 106 op/s 2024-09-10T23:20:21.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29710 5.78 MB/sec execute 139 sec latency 152.263 ms 2024-09-10T23:20:21.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 145453 27.61 MB/sec execute 137 sec latency 429.098 ms 2024-09-10T23:20:22.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 29871 5.83 MB/sec execute 140 sec latency 86.452 ms 2024-09-10T23:20:22.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 146226 27.71 MB/sec execute 138 sec latency 116.458 ms 2024-09-10T23:20:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:22 smithi046 ceph-mon[28128]: pgmap v798: 129 pgs: 129 active+clean; 426 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2024-09-10T23:20:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:22 smithi073 ceph-mon[35473]: pgmap v798: 129 pgs: 129 active+clean; 426 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2024-09-10T23:20:23.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30025 5.87 MB/sec execute 141 sec latency 195.558 ms 2024-09-10T23:20:23.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 146330 27.53 MB/sec execute 139 sec latency 532.772 ms 2024-09-10T23:20:24.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30161 5.89 MB/sec execute 142 sec latency 311.466 ms 2024-09-10T23:20:24.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 147195 27.62 MB/sec execute 140 sec latency 277.499 ms 2024-09-10T23:20:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:24 smithi046 ceph-mon[28128]: pgmap v799: 129 pgs: 129 active+clean; 425 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 KiB/s rd, 3.0 MiB/s wr, 136 op/s 2024-09-10T23:20:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:24 smithi073 ceph-mon[35473]: pgmap v799: 129 pgs: 129 active+clean; 425 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 KiB/s rd, 3.0 MiB/s wr, 136 op/s 2024-09-10T23:20:25.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30323 5.87 MB/sec execute 143 sec latency 91.269 ms 2024-09-10T23:20:25.846 INFO:tasks.workunit.client.0.smithi046.stdout: 10 148087 27.81 MB/sec execute 141 sec latency 273.422 ms 2024-09-10T23:20:26.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30464 5.84 MB/sec execute 144 sec latency 90.408 ms 2024-09-10T23:20:26.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 149398 28.16 MB/sec execute 142 sec latency 422.676 ms 2024-09-10T23:20:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:26 smithi046 ceph-mon[28128]: pgmap v800: 129 pgs: 129 active+clean; 424 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-09-10T23:20:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:26 smithi073 ceph-mon[35473]: pgmap v800: 129 pgs: 129 active+clean; 424 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-09-10T23:20:27.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30604 5.81 MB/sec execute 145 sec latency 73.488 ms 2024-09-10T23:20:27.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 149769 28.08 MB/sec execute 143 sec latency 115.135 ms 2024-09-10T23:20:28.426 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30767 5.83 MB/sec execute 146 sec latency 74.068 ms 2024-09-10T23:20:28.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 149893 27.90 MB/sec execute 144 sec latency 542.717 ms 2024-09-10T23:20:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:28 smithi046 ceph-mon[28128]: pgmap v801: 129 pgs: 129 active+clean; 424 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 3.1 MiB/s wr, 179 op/s 2024-09-10T23:20:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:28 smithi073 ceph-mon[35473]: pgmap v801: 129 pgs: 129 active+clean; 424 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 3.1 MiB/s wr, 179 op/s 2024-09-10T23:20:29.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 30892 5.82 MB/sec execute 147 sec latency 153.197 ms 2024-09-10T23:20:29.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 151019 28.04 MB/sec execute 145 sec latency 146.210 ms 2024-09-10T23:20:30.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:29 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:30.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:29 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:30.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31029 5.85 MB/sec execute 148 sec latency 92.618 ms 2024-09-10T23:20:30.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 152146 28.36 MB/sec execute 146 sec latency 147.977 ms 2024-09-10T23:20:30.974 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:30 smithi073 ceph-mon[35473]: pgmap v802: 129 pgs: 129 active+clean; 424 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 2.2 MiB/s wr, 148 op/s 2024-09-10T23:20:30.974 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:30 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:30.974 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:30 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:30.974 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:30 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:20:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:30 smithi046 ceph-mon[28128]: pgmap v802: 129 pgs: 129 active+clean; 424 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 2.2 MiB/s wr, 148 op/s 2024-09-10T23:20:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:30 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:20:31.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31168 5.88 MB/sec execute 149 sec latency 96.313 ms 2024-09-10T23:20:31.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 153093 28.54 MB/sec execute 147 sec latency 295.968 ms 2024-09-10T23:20:32.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:32.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31345 5.94 MB/sec execute 150 sec latency 89.244 ms 2024-09-10T23:20:32.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 153400 28.43 MB/sec execute 148 sec latency 125.823 ms 2024-09-10T23:20:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:32 smithi046 ceph-mon[28128]: pgmap v803: 129 pgs: 129 active+clean; 429 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.8 KiB/s rd, 3.1 MiB/s wr, 196 op/s 2024-09-10T23:20:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:32 smithi073 ceph-mon[35473]: pgmap v803: 129 pgs: 129 active+clean; 429 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.8 KiB/s rd, 3.1 MiB/s wr, 196 op/s 2024-09-10T23:20:33.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31562 6.04 MB/sec execute 151 sec latency 103.236 ms 2024-09-10T23:20:33.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 154042 28.49 MB/sec execute 149 sec latency 555.629 ms 2024-09-10T23:20:34.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31709 6.04 MB/sec execute 152 sec latency 213.470 ms 2024-09-10T23:20:34.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 155234 28.73 MB/sec execute 150 sec latency 573.370 ms 2024-09-10T23:20:35.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:34 smithi046 ceph-mon[28128]: pgmap v804: 129 pgs: 129 active+clean; 430 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-10T23:20:35.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:34 smithi073 ceph-mon[35473]: pgmap v804: 129 pgs: 129 active+clean; 430 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-10T23:20:35.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31811 6.04 MB/sec execute 153 sec latency 283.445 ms 2024-09-10T23:20:35.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 156547 29.02 MB/sec execute 151 sec latency 137.265 ms 2024-09-10T23:20:36.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31883 6.04 MB/sec execute 154 sec latency 85.654 ms 2024-09-10T23:20:36.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 156878 28.93 MB/sec execute 152 sec latency 218.872 ms 2024-09-10T23:20:36.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:36 smithi046 ceph-mon[28128]: pgmap v805: 129 pgs: 129 active+clean; 439 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.4 MiB/s wr, 161 op/s 2024-09-10T23:20:37.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:36 smithi073 ceph-mon[35473]: pgmap v805: 129 pgs: 129 active+clean; 439 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.4 MiB/s wr, 161 op/s 2024-09-10T23:20:37.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 31973 6.05 MB/sec execute 155 sec latency 87.751 ms 2024-09-10T23:20:37.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 157609 29.00 MB/sec execute 153 sec latency 118.635 ms 2024-09-10T23:20:38.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32113 6.11 MB/sec execute 156 sec latency 104.588 ms 2024-09-10T23:20:38.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158305 28.96 MB/sec execute 154 sec latency 500.983 ms 2024-09-10T23:20:39.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:38 smithi046 ceph-mon[28128]: pgmap v806: 129 pgs: 129 active+clean; 448 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 131 op/s 2024-09-10T23:20:39.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:38 smithi073 ceph-mon[35473]: pgmap v806: 129 pgs: 129 active+clean; 448 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 131 op/s 2024-09-10T23:20:39.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32156 6.08 MB/sec execute 157 sec latency 454.576 ms 2024-09-10T23:20:39.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158380 28.82 MB/sec execute 155 sec latency 1305.982 ms 2024-09-10T23:20:40.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32178 6.04 MB/sec execute 158 sec latency 738.706 ms 2024-09-10T23:20:40.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158585 28.76 MB/sec execute 156 sec latency 1240.682 ms 2024-09-10T23:20:41.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:40 smithi046 ceph-mon[28128]: pgmap v807: 129 pgs: 129 active+clean; 448 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.5 MiB/s wr, 117 op/s 2024-09-10T23:20:41.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:40 smithi073 ceph-mon[35473]: pgmap v807: 129 pgs: 129 active+clean; 448 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.5 MiB/s wr, 117 op/s 2024-09-10T23:20:41.427 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32249 6.07 MB/sec execute 159 sec latency 1109.096 ms 2024-09-10T23:20:41.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158611 28.58 MB/sec execute 157 sec latency 1378.997 ms 2024-09-10T23:20:42.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32341 6.05 MB/sec execute 160 sec latency 288.870 ms 2024-09-10T23:20:42.847 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158735 28.47 MB/sec execute 158 sec latency 995.534 ms 2024-09-10T23:20:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:42 smithi046 ceph-mon[28128]: pgmap v808: 129 pgs: 129 active+clean; 449 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 4.3 MiB/s wr, 141 op/s 2024-09-10T23:20:43.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:42 smithi073 ceph-mon[35473]: pgmap v808: 129 pgs: 129 active+clean; 449 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 4.3 MiB/s wr, 141 op/s 2024-09-10T23:20:43.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32369 6.02 MB/sec execute 161 sec latency 472.606 ms 2024-09-10T23:20:43.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158826 28.32 MB/sec execute 159 sec latency 1042.472 ms 2024-09-10T23:20:44.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32443 6.00 MB/sec execute 162 sec latency 419.023 ms 2024-09-10T23:20:44.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 158898 28.16 MB/sec execute 160 sec latency 1279.573 ms 2024-09-10T23:20:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:44 smithi046 ceph-mon[28128]: pgmap v809: 129 pgs: 129 active+clean; 449 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.4 MiB/s wr, 89 op/s 2024-09-10T23:20:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:44 smithi073 ceph-mon[35473]: pgmap v809: 129 pgs: 129 active+clean; 449 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.4 MiB/s wr, 89 op/s 2024-09-10T23:20:45.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32478 5.97 MB/sec execute 163 sec latency 479.616 ms 2024-09-10T23:20:45.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159050 28.03 MB/sec execute 161 sec latency 1318.070 ms 2024-09-10T23:20:46.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32522 5.93 MB/sec execute 164 sec latency 464.114 ms 2024-09-10T23:20:46.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159051 27.86 MB/sec execute 162 sec latency 1226.739 ms 2024-09-10T23:20:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:46 smithi046 ceph-mon[28128]: pgmap v810: 129 pgs: 129 active+clean; 450 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.5 MiB/s wr, 93 op/s 2024-09-10T23:20:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:46 smithi073 ceph-mon[35473]: pgmap v810: 129 pgs: 129 active+clean; 450 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.5 MiB/s wr, 93 op/s 2024-09-10T23:20:47.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:20:47.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32607 5.90 MB/sec execute 165 sec latency 305.006 ms 2024-09-10T23:20:47.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159117 27.72 MB/sec execute 163 sec latency 1617.378 ms 2024-09-10T23:20:48.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32673 5.87 MB/sec execute 166 sec latency 453.268 ms 2024-09-10T23:20:48.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159173 27.56 MB/sec execute 164 sec latency 1438.187 ms 2024-09-10T23:20:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:48 smithi046 ceph-mon[28128]: pgmap v811: 129 pgs: 129 active+clean; 454 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.1 MiB/s wr, 91 op/s 2024-09-10T23:20:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:48 smithi073 ceph-mon[35473]: pgmap v811: 129 pgs: 129 active+clean; 454 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.1 MiB/s wr, 91 op/s 2024-09-10T23:20:49.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32753 5.84 MB/sec execute 167 sec latency 319.667 ms 2024-09-10T23:20:49.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159208 27.40 MB/sec execute 165 sec latency 1257.652 ms 2024-09-10T23:20:50.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32807 5.81 MB/sec execute 168 sec latency 442.179 ms 2024-09-10T23:20:50.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159280 27.27 MB/sec execute 166 sec latency 1383.277 ms 2024-09-10T23:20:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:50 smithi046 ceph-mon[28128]: pgmap v812: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.1 MiB/s wr, 65 op/s 2024-09-10T23:20:51.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:50 smithi073 ceph-mon[35473]: pgmap v812: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.1 MiB/s wr, 65 op/s 2024-09-10T23:20:51.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32894 5.79 MB/sec execute 169 sec latency 320.875 ms 2024-09-10T23:20:51.848 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159453 27.16 MB/sec execute 167 sec latency 1303.422 ms 2024-09-10T23:20:52.428 INFO:tasks.workunit.client.1.smithi073.stdout: 10 32969 5.77 MB/sec execute 170 sec latency 465.905 ms 2024-09-10T23:20:52.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159699 27.12 MB/sec execute 168 sec latency 1187.410 ms 2024-09-10T23:20:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:52 smithi046 ceph-mon[28128]: pgmap v813: 129 pgs: 129 active+clean; 450 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.1 MiB/s wr, 76 op/s 2024-09-10T23:20:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:52 smithi073 ceph-mon[35473]: pgmap v813: 129 pgs: 129 active+clean; 450 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.1 MiB/s wr, 76 op/s 2024-09-10T23:20:53.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33018 5.75 MB/sec execute 171 sec latency 455.300 ms 2024-09-10T23:20:53.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159865 26.99 MB/sec execute 169 sec latency 1233.181 ms 2024-09-10T23:20:54.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33105 5.75 MB/sec execute 172 sec latency 475.176 ms 2024-09-10T23:20:54.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 160169 26.92 MB/sec execute 170 sec latency 878.961 ms 2024-09-10T23:20:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:54 smithi046 ceph-mon[28128]: pgmap v814: 129 pgs: 129 active+clean; 450 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-10T23:20:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:54 smithi073 ceph-mon[35473]: pgmap v814: 129 pgs: 129 active+clean; 450 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-10T23:20:55.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33233 5.75 MB/sec execute 173 sec latency 93.535 ms 2024-09-10T23:20:55.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 160525 26.85 MB/sec execute 171 sec latency 96.473 ms 2024-09-10T23:20:56.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33377 5.77 MB/sec execute 174 sec latency 100.559 ms 2024-09-10T23:20:56.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 161623 26.97 MB/sec execute 172 sec latency 166.357 ms 2024-09-10T23:20:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:56 smithi046 ceph-mon[28128]: pgmap v815: 129 pgs: 129 active+clean; 443 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 1.6 MiB/s wr, 90 op/s 2024-09-10T23:20:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:56 smithi073 ceph-mon[35473]: pgmap v815: 129 pgs: 129 active+clean; 443 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 1.6 MiB/s wr, 90 op/s 2024-09-10T23:20:57.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33549 5.82 MB/sec execute 175 sec latency 111.780 ms 2024-09-10T23:20:57.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 162742 27.23 MB/sec execute 173 sec latency 213.934 ms 2024-09-10T23:20:58.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33692 5.84 MB/sec execute 176 sec latency 99.377 ms 2024-09-10T23:20:58.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 163716 27.40 MB/sec execute 174 sec latency 145.233 ms 2024-09-10T23:20:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:20:58 smithi046 ceph-mon[28128]: pgmap v816: 129 pgs: 129 active+clean; 436 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.9 MiB/s wr, 127 op/s 2024-09-10T23:20:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:20:58 smithi073 ceph-mon[35473]: pgmap v816: 129 pgs: 129 active+clean; 436 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.9 MiB/s wr, 127 op/s 2024-09-10T23:20:59.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33852 5.82 MB/sec execute 177 sec latency 80.404 ms 2024-09-10T23:20:59.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 163957 27.31 MB/sec execute 175 sec latency 481.026 ms 2024-09-10T23:21:00.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 33920 5.79 MB/sec execute 178 sec latency 413.956 ms 2024-09-10T23:21:00.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 163969 27.16 MB/sec execute 176 sec latency 1211.012 ms 2024-09-10T23:21:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:00 smithi046 ceph-mon[28128]: pgmap v817: 129 pgs: 129 active+clean; 436 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.5 MiB/s wr, 108 op/s 2024-09-10T23:21:01.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:00 smithi073 ceph-mon[35473]: pgmap v817: 129 pgs: 129 active+clean; 436 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.3 KiB/s rd, 1.5 MiB/s wr, 108 op/s 2024-09-10T23:21:01.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34011 5.77 MB/sec execute 179 sec latency 373.602 ms 2024-09-10T23:21:01.852 INFO:tasks.workunit.client.0.smithi046.stdout: 10 163970 27.01 MB/sec execute 177 sec latency 1395.793 ms 2024-09-10T23:21:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:02.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34110 5.74 MB/sec execute 180 sec latency 327.456 ms 2024-09-10T23:21:02.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 164105 26.87 MB/sec execute 178 sec latency 1218.610 ms 2024-09-10T23:21:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:02 smithi046 ceph-mon[28128]: pgmap v818: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-10T23:21:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:02 smithi073 ceph-mon[35473]: pgmap v818: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-10T23:21:03.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34264 5.74 MB/sec execute 181 sec latency 84.291 ms 2024-09-10T23:21:03.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 165394 27.05 MB/sec execute 179 sec latency 117.238 ms 2024-09-10T23:21:04.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34407 5.74 MB/sec execute 182 sec latency 78.272 ms 2024-09-10T23:21:04.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 166924 27.45 MB/sec execute 180 sec latency 126.097 ms 2024-09-10T23:21:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:04 smithi046 ceph-mon[28128]: pgmap v819: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-09-10T23:21:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:04 smithi073 ceph-mon[35473]: pgmap v819: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-09-10T23:21:05.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34564 5.78 MB/sec execute 183 sec latency 85.471 ms 2024-09-10T23:21:05.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 167474 27.46 MB/sec execute 181 sec latency 166.177 ms 2024-09-10T23:21:06.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34694 5.78 MB/sec execute 184 sec latency 90.566 ms 2024-09-10T23:21:06.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 167915 27.43 MB/sec execute 182 sec latency 101.730 ms 2024-09-10T23:21:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:06 smithi046 ceph-mon[28128]: pgmap v820: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.6 KiB/s rd, 2.3 MiB/s wr, 162 op/s 2024-09-10T23:21:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:06 smithi073 ceph-mon[35473]: pgmap v820: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.6 KiB/s rd, 2.3 MiB/s wr, 162 op/s 2024-09-10T23:21:07.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34876 5.85 MB/sec execute 185 sec latency 84.455 ms 2024-09-10T23:21:07.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 168289 27.38 MB/sec execute 183 sec latency 782.124 ms 2024-09-10T23:21:08.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 34935 5.82 MB/sec execute 186 sec latency 455.390 ms 2024-09-10T23:21:08.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 168366 27.23 MB/sec execute 184 sec latency 1384.537 ms 2024-09-10T23:21:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:08 smithi046 ceph-mon[28128]: pgmap v821: 129 pgs: 129 active+clean; 422 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.6 MiB/s wr, 151 op/s 2024-09-10T23:21:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:08 smithi073 ceph-mon[35473]: pgmap v821: 129 pgs: 129 active+clean; 422 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.6 MiB/s wr, 151 op/s 2024-09-10T23:21:09.429 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35030 5.86 MB/sec execute 187 sec latency 472.407 ms 2024-09-10T23:21:09.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 168402 27.09 MB/sec execute 185 sec latency 1029.485 ms 2024-09-10T23:21:10.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35168 5.88 MB/sec execute 188 sec latency 455.786 ms 2024-09-10T23:21:10.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 169611 27.33 MB/sec execute 186 sec latency 779.483 ms 2024-09-10T23:21:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:10 smithi046 ceph-mon[28128]: pgmap v822: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.2 MiB/s wr, 113 op/s 2024-09-10T23:21:11.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:10 smithi073 ceph-mon[35473]: pgmap v822: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.2 MiB/s wr, 113 op/s 2024-09-10T23:21:11.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35313 5.88 MB/sec execute 189 sec latency 176.051 ms 2024-09-10T23:21:11.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 170738 27.53 MB/sec execute 187 sec latency 175.760 ms 2024-09-10T23:21:12.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35421 5.90 MB/sec execute 190 sec latency 95.486 ms 2024-09-10T23:21:12.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 171059 27.46 MB/sec execute 188 sec latency 111.548 ms 2024-09-10T23:21:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:12 smithi046 ceph-mon[28128]: pgmap v823: 129 pgs: 129 active+clean; 434 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.3 MiB/s wr, 138 op/s 2024-09-10T23:21:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:12 smithi073 ceph-mon[35473]: pgmap v823: 129 pgs: 129 active+clean; 434 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.3 MiB/s wr, 138 op/s 2024-09-10T23:21:13.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35492 5.90 MB/sec execute 191 sec latency 93.012 ms 2024-09-10T23:21:13.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 171788 27.52 MB/sec execute 189 sec latency 115.985 ms 2024-09-10T23:21:14.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35609 5.92 MB/sec execute 192 sec latency 93.001 ms 2024-09-10T23:21:14.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 172963 27.72 MB/sec execute 190 sec latency 134.468 ms 2024-09-10T23:21:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:14 smithi046 ceph-mon[28128]: pgmap v824: 129 pgs: 129 active+clean; 436 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.9 MiB/s wr, 90 op/s 2024-09-10T23:21:15.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:14 smithi073 ceph-mon[35473]: pgmap v824: 129 pgs: 129 active+clean; 436 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.9 MiB/s wr, 90 op/s 2024-09-10T23:21:15.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35770 5.99 MB/sec execute 193 sec latency 142.581 ms 2024-09-10T23:21:15.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 173386 27.68 MB/sec execute 191 sec latency 582.273 ms 2024-09-10T23:21:16.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35830 5.96 MB/sec execute 194 sec latency 496.422 ms 2024-09-10T23:21:16.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 173407 27.54 MB/sec execute 192 sec latency 1211.061 ms 2024-09-10T23:21:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:16 smithi046 ceph-mon[28128]: pgmap v825: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.9 MiB/s wr, 128 op/s 2024-09-10T23:21:17.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:17.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:16 smithi073 ceph-mon[35473]: pgmap v825: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.9 MiB/s wr, 128 op/s 2024-09-10T23:21:17.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:17.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 35913 5.95 MB/sec execute 195 sec latency 445.463 ms 2024-09-10T23:21:17.853 INFO:tasks.workunit.client.0.smithi046.stdout: 10 173407 27.40 MB/sec execute 193 sec latency 2211.111 ms 2024-09-10T23:21:18.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36013 5.93 MB/sec execute 196 sec latency 126.669 ms 2024-09-10T23:21:18.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 174268 27.52 MB/sec execute 194 sec latency 2806.192 ms 2024-09-10T23:21:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:18 smithi046 ceph-mon[28128]: pgmap v826: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.9 MiB/s wr, 103 op/s 2024-09-10T23:21:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:18 smithi073 ceph-mon[35473]: pgmap v826: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.9 MiB/s wr, 103 op/s 2024-09-10T23:21:19.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36116 5.91 MB/sec execute 197 sec latency 98.157 ms 2024-09-10T23:21:19.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 174616 27.45 MB/sec execute 195 sec latency 122.434 ms 2024-09-10T23:21:20.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36220 5.89 MB/sec execute 198 sec latency 100.979 ms 2024-09-10T23:21:20.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 175390 27.51 MB/sec execute 196 sec latency 109.860 ms 2024-09-10T23:21:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:20 smithi046 ceph-mon[28128]: pgmap v827: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.4 MiB/s wr, 90 op/s 2024-09-10T23:21:21.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:20 smithi073 ceph-mon[35473]: pgmap v827: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.4 MiB/s wr, 90 op/s 2024-09-10T23:21:21.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36294 5.87 MB/sec execute 199 sec latency 420.755 ms 2024-09-10T23:21:21.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 176673 27.73 MB/sec execute 197 sec latency 136.796 ms 2024-09-10T23:21:22.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36419 5.85 MB/sec execute 200 sec latency 112.205 ms 2024-09-10T23:21:22.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 177854 27.94 MB/sec execute 198 sec latency 170.741 ms 2024-09-10T23:21:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:22 smithi046 ceph-mon[28128]: pgmap v828: 129 pgs: 129 active+clean; 445 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.0 KiB/s rd, 4.1 MiB/s wr, 129 op/s 2024-09-10T23:21:23.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:22 smithi073 ceph-mon[35473]: pgmap v828: 129 pgs: 129 active+clean; 445 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.0 KiB/s rd, 4.1 MiB/s wr, 129 op/s 2024-09-10T23:21:23.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36547 5.84 MB/sec execute 201 sec latency 153.614 ms 2024-09-10T23:21:23.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 178092 27.86 MB/sec execute 199 sec latency 430.769 ms 2024-09-10T23:21:24.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36657 5.84 MB/sec execute 202 sec latency 289.763 ms 2024-09-10T23:21:24.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 178095 27.72 MB/sec execute 200 sec latency 1196.748 ms 2024-09-10T23:21:25.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:24 smithi046 ceph-mon[28128]: pgmap v829: 129 pgs: 129 active+clean; 444 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 99 op/s 2024-09-10T23:21:25.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:24 smithi073 ceph-mon[35473]: pgmap v829: 129 pgs: 129 active+clean; 444 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 99 op/s 2024-09-10T23:21:25.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36728 5.83 MB/sec execute 203 sec latency 496.134 ms 2024-09-10T23:21:25.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 178106 27.58 MB/sec execute 201 sec latency 1194.660 ms 2024-09-10T23:21:26.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36774 5.80 MB/sec execute 204 sec latency 422.648 ms 2024-09-10T23:21:26.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 178151 27.45 MB/sec execute 202 sec latency 1402.488 ms 2024-09-10T23:21:27.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:26 smithi046 ceph-mon[28128]: pgmap v830: 129 pgs: 129 active+clean; 439 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.1 MiB/s wr, 132 op/s 2024-09-10T23:21:27.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:26 smithi073 ceph-mon[35473]: pgmap v830: 129 pgs: 129 active+clean; 439 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.1 MiB/s wr, 132 op/s 2024-09-10T23:21:27.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 36938 5.86 MB/sec execute 205 sec latency 409.588 ms 2024-09-10T23:21:27.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 178897 27.50 MB/sec execute 203 sec latency 142.353 ms 2024-09-10T23:21:28.430 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37095 5.86 MB/sec execute 206 sec latency 86.704 ms 2024-09-10T23:21:28.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 179852 27.59 MB/sec execute 204 sec latency 289.258 ms 2024-09-10T23:21:29.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:28 smithi046 ceph-mon[28128]: pgmap v831: 129 pgs: 129 active+clean; 433 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 126 op/s 2024-09-10T23:21:29.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:28 smithi073 ceph-mon[35473]: pgmap v831: 129 pgs: 129 active+clean; 433 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 126 op/s 2024-09-10T23:21:29.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37266 5.89 MB/sec execute 207 sec latency 88.085 ms 2024-09-10T23:21:29.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 181331 27.90 MB/sec execute 205 sec latency 371.301 ms 2024-09-10T23:21:30.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37407 5.87 MB/sec execute 208 sec latency 83.231 ms 2024-09-10T23:21:30.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 181674 27.84 MB/sec execute 206 sec latency 115.584 ms 2024-09-10T23:21:31.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:30 smithi046 ceph-mon[28128]: pgmap v832: 129 pgs: 129 active+clean; 431 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.2 MiB/s wr, 123 op/s 2024-09-10T23:21:31.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:30 smithi073 ceph-mon[35473]: pgmap v832: 129 pgs: 129 active+clean; 431 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.2 MiB/s wr, 123 op/s 2024-09-10T23:21:31.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37546 5.85 MB/sec execute 209 sec latency 71.862 ms 2024-09-10T23:21:31.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 181981 27.77 MB/sec execute 207 sec latency 142.411 ms 2024-09-10T23:21:32.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:32.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:32.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37671 5.83 MB/sec execute 210 sec latency 84.094 ms 2024-09-10T23:21:32.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 182514 27.77 MB/sec execute 208 sec latency 686.393 ms 2024-09-10T23:21:33.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:32 smithi073 ceph-mon[35473]: pgmap v833: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 8.5 KiB/s rd, 2.8 MiB/s wr, 175 op/s 2024-09-10T23:21:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:33.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:32 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:21:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:32 smithi046 ceph-mon[28128]: pgmap v833: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 8.5 KiB/s rd, 2.8 MiB/s wr, 175 op/s 2024-09-10T23:21:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:32 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:21:33.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37783 5.83 MB/sec execute 211 sec latency 386.373 ms 2024-09-10T23:21:33.854 INFO:tasks.workunit.client.0.smithi046.stdout: 10 183146 27.75 MB/sec execute 209 sec latency 780.797 ms 2024-09-10T23:21:34.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 37899 5.82 MB/sec execute 212 sec latency 235.889 ms 2024-09-10T23:21:34.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 184037 27.91 MB/sec execute 210 sec latency 787.929 ms 2024-09-10T23:21:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:34 smithi046 ceph-mon[28128]: pgmap v834: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 MiB/s wr, 134 op/s 2024-09-10T23:21:35.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:34 smithi073 ceph-mon[35473]: pgmap v834: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 MiB/s wr, 134 op/s 2024-09-10T23:21:35.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38053 5.83 MB/sec execute 213 sec latency 84.404 ms 2024-09-10T23:21:35.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 185091 28.06 MB/sec execute 211 sec latency 137.666 ms 2024-09-10T23:21:36.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38193 5.85 MB/sec execute 214 sec latency 81.075 ms 2024-09-10T23:21:36.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 185326 27.97 MB/sec execute 212 sec latency 100.492 ms 2024-09-10T23:21:37.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:36 smithi046 ceph-mon[28128]: pgmap v835: 129 pgs: 129 active+clean; 433 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 173 op/s 2024-09-10T23:21:37.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:36 smithi073 ceph-mon[35473]: pgmap v835: 129 pgs: 129 active+clean; 433 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 173 op/s 2024-09-10T23:21:37.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38351 5.89 MB/sec execute 215 sec latency 79.706 ms 2024-09-10T23:21:37.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 186369 28.04 MB/sec execute 213 sec latency 128.008 ms 2024-09-10T23:21:38.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38507 5.91 MB/sec execute 216 sec latency 83.514 ms 2024-09-10T23:21:38.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 187571 28.27 MB/sec execute 214 sec latency 121.126 ms 2024-09-10T23:21:39.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:38 smithi046 ceph-mon[28128]: pgmap v836: 129 pgs: 129 active+clean; 436 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 156 op/s 2024-09-10T23:21:39.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:38 smithi073 ceph-mon[35473]: pgmap v836: 129 pgs: 129 active+clean; 436 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 156 op/s 2024-09-10T23:21:39.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38714 5.98 MB/sec execute 217 sec latency 171.582 ms 2024-09-10T23:21:39.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 187692 28.17 MB/sec execute 215 sec latency 1009.109 ms 2024-09-10T23:21:40.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38859 5.99 MB/sec execute 218 sec latency 246.786 ms 2024-09-10T23:21:40.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 188738 28.32 MB/sec execute 216 sec latency 388.685 ms 2024-09-10T23:21:41.131 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:40 smithi073 ceph-mon[35473]: pgmap v837: 129 pgs: 129 active+clean; 439 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.3 MiB/s wr, 124 op/s 2024-09-10T23:21:41.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:40 smithi046 ceph-mon[28128]: pgmap v837: 129 pgs: 129 active+clean; 439 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.3 MiB/s wr, 124 op/s 2024-09-10T23:21:41.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 38960 5.99 MB/sec execute 219 sec latency 408.259 ms 2024-09-10T23:21:41.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 188969 28.23 MB/sec execute 217 sec latency 108.702 ms 2024-09-10T23:21:42.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39016 5.98 MB/sec execute 220 sec latency 102.328 ms 2024-09-10T23:21:42.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 190236 28.36 MB/sec execute 218 sec latency 117.840 ms 2024-09-10T23:21:43.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:42 smithi046 ceph-mon[28128]: pgmap v838: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 163 op/s 2024-09-10T23:21:43.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:42 smithi073 ceph-mon[35473]: pgmap v838: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 163 op/s 2024-09-10T23:21:43.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39122 5.99 MB/sec execute 221 sec latency 97.490 ms 2024-09-10T23:21:43.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 191772 28.68 MB/sec execute 219 sec latency 143.890 ms 2024-09-10T23:21:44.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39248 6.01 MB/sec execute 222 sec latency 78.306 ms 2024-09-10T23:21:44.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 192282 28.67 MB/sec execute 220 sec latency 148.802 ms 2024-09-10T23:21:45.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:44 smithi046 ceph-mon[28128]: pgmap v839: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.1 MiB/s wr, 110 op/s 2024-09-10T23:21:45.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:44 smithi073 ceph-mon[35473]: pgmap v839: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.1 MiB/s wr, 110 op/s 2024-09-10T23:21:45.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39411 6.05 MB/sec execute 223 sec latency 91.315 ms 2024-09-10T23:21:45.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 192564 28.59 MB/sec execute 221 sec latency 109.059 ms 2024-09-10T23:21:46.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39527 6.04 MB/sec execute 224 sec latency 103.801 ms 2024-09-10T23:21:46.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 193915 28.76 MB/sec execute 222 sec latency 137.579 ms 2024-09-10T23:21:47.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:46 smithi046 ceph-mon[28128]: pgmap v840: 129 pgs: 129 active+clean; 456 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.0 KiB/s rd, 4.1 MiB/s wr, 146 op/s 2024-09-10T23:21:47.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:46 smithi073 ceph-mon[35473]: pgmap v840: 129 pgs: 129 active+clean; 456 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.0 KiB/s rd, 4.1 MiB/s wr, 146 op/s 2024-09-10T23:21:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:21:47.431 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39624 6.02 MB/sec execute 225 sec latency 90.886 ms 2024-09-10T23:21:47.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 195264 29.04 MB/sec execute 223 sec latency 136.550 ms 2024-09-10T23:21:48.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39721 6.00 MB/sec execute 226 sec latency 115.846 ms 2024-09-10T23:21:48.855 INFO:tasks.workunit.client.0.smithi046.stdout: 10 195874 29.02 MB/sec execute 224 sec latency 119.682 ms 2024-09-10T23:21:49.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:48 smithi046 ceph-mon[28128]: pgmap v841: 129 pgs: 129 active+clean; 456 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 4.2 MiB/s wr, 114 op/s 2024-09-10T23:21:49.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:48 smithi073 ceph-mon[35473]: pgmap v841: 129 pgs: 129 active+clean; 456 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 4.2 MiB/s wr, 114 op/s 2024-09-10T23:21:49.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39832 5.99 MB/sec execute 227 sec latency 120.267 ms 2024-09-10T23:21:49.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 196301 28.99 MB/sec execute 225 sec latency 151.921 ms 2024-09-10T23:21:50.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 39932 5.96 MB/sec execute 228 sec latency 287.592 ms 2024-09-10T23:21:50.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 196658 28.94 MB/sec execute 226 sec latency 716.837 ms 2024-09-10T23:21:51.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:50 smithi046 ceph-mon[28128]: pgmap v842: 129 pgs: 129 active+clean; 457 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.8 MiB/s wr, 102 op/s 2024-09-10T23:21:51.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:50 smithi073 ceph-mon[35473]: pgmap v842: 129 pgs: 129 active+clean; 457 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.8 MiB/s wr, 102 op/s 2024-09-10T23:21:51.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40021 5.95 MB/sec execute 229 sec latency 377.548 ms 2024-09-10T23:21:51.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 197931 29.12 MB/sec execute 227 sec latency 761.868 ms 2024-09-10T23:21:52.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40156 5.96 MB/sec execute 230 sec latency 125.915 ms 2024-09-10T23:21:52.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 199142 29.29 MB/sec execute 228 sec latency 134.738 ms 2024-09-10T23:21:53.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:52 smithi046 ceph-mon[28128]: pgmap v843: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 4.4 MiB/s wr, 146 op/s 2024-09-10T23:21:53.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:52 smithi073 ceph-mon[35473]: pgmap v843: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 4.4 MiB/s wr, 146 op/s 2024-09-10T23:21:53.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40288 5.95 MB/sec execute 231 sec latency 94.452 ms 2024-09-10T23:21:53.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 199441 29.22 MB/sec execute 229 sec latency 121.458 ms 2024-09-10T23:21:54.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40447 5.99 MB/sec execute 232 sec latency 80.854 ms 2024-09-10T23:21:54.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 199862 29.19 MB/sec execute 230 sec latency 401.529 ms 2024-09-10T23:21:55.171 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:54 smithi046 ceph-mon[28128]: pgmap v844: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 103 op/s 2024-09-10T23:21:55.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:54 smithi073 ceph-mon[35473]: pgmap v844: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 103 op/s 2024-09-10T23:21:55.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40604 6.00 MB/sec execute 233 sec latency 111.692 ms 2024-09-10T23:21:55.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 201103 29.34 MB/sec execute 231 sec latency 182.611 ms 2024-09-10T23:21:56.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40715 5.99 MB/sec execute 234 sec latency 433.455 ms 2024-09-10T23:21:56.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 201572 29.34 MB/sec execute 232 sec latency 832.067 ms 2024-09-10T23:21:57.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:56 smithi046 ceph-mon[28128]: pgmap v845: 129 pgs: 129 active+clean; 437 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 167 op/s 2024-09-10T23:21:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:56 smithi073 ceph-mon[35473]: pgmap v845: 129 pgs: 129 active+clean; 437 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 167 op/s 2024-09-10T23:21:57.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 40870 6.01 MB/sec execute 235 sec latency 95.159 ms 2024-09-10T23:21:57.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 202689 29.48 MB/sec execute 233 sec latency 170.074 ms 2024-09-10T23:21:58.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41010 5.99 MB/sec execute 236 sec latency 94.443 ms 2024-09-10T23:21:58.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 203008 29.42 MB/sec execute 234 sec latency 116.952 ms 2024-09-10T23:21:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:21:58 smithi046 ceph-mon[28128]: pgmap v846: 129 pgs: 129 active+clean; 421 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 3.1 MiB/s wr, 150 op/s 2024-09-10T23:21:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:21:58 smithi073 ceph-mon[35473]: pgmap v846: 129 pgs: 129 active+clean; 421 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 3.1 MiB/s wr, 150 op/s 2024-09-10T23:21:59.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41154 5.97 MB/sec execute 237 sec latency 84.233 ms 2024-09-10T23:21:59.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 203921 29.47 MB/sec execute 235 sec latency 132.368 ms 2024-09-10T23:22:00.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41302 5.97 MB/sec execute 238 sec latency 76.383 ms 2024-09-10T23:22:00.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 205199 29.66 MB/sec execute 236 sec latency 122.531 ms 2024-09-10T23:22:01.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:00 smithi046 ceph-mon[28128]: pgmap v847: 129 pgs: 129 active+clean; 421 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2024-09-10T23:22:01.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:00 smithi073 ceph-mon[35473]: pgmap v847: 129 pgs: 129 active+clean; 421 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2024-09-10T23:22:01.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41460 5.98 MB/sec execute 239 sec latency 82.385 ms 2024-09-10T23:22:01.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206132 29.77 MB/sec execute 237 sec latency 517.249 ms 2024-09-10T23:22:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:02.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:02.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41529 5.96 MB/sec execute 240 sec latency 447.265 ms 2024-09-10T23:22:02.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206155 29.66 MB/sec execute 238 sec latency 1221.519 ms 2024-09-10T23:22:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:02 smithi046 ceph-mon[28128]: pgmap v848: 129 pgs: 129 active+clean; 424 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.0 MiB/s wr, 197 op/s 2024-09-10T23:22:03.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:02 smithi073 ceph-mon[35473]: pgmap v848: 129 pgs: 129 active+clean; 424 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.0 MiB/s wr, 197 op/s 2024-09-10T23:22:03.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41592 5.95 MB/sec execute 241 sec latency 478.448 ms 2024-09-10T23:22:03.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206165 29.53 MB/sec execute 239 sec latency 1318.256 ms 2024-09-10T23:22:04.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41663 5.95 MB/sec execute 242 sec latency 389.859 ms 2024-09-10T23:22:04.856 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206169 29.41 MB/sec execute 240 sec latency 1214.897 ms 2024-09-10T23:22:05.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:04 smithi046 ceph-mon[28128]: pgmap v849: 129 pgs: 129 active+clean; 424 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-09-10T23:22:05.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:04 smithi073 ceph-mon[35473]: pgmap v849: 129 pgs: 129 active+clean; 424 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-09-10T23:22:05.432 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41748 5.94 MB/sec execute 243 sec latency 479.520 ms 2024-09-10T23:22:05.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206192 29.29 MB/sec execute 241 sec latency 1229.419 ms 2024-09-10T23:22:06.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41820 5.94 MB/sec execute 244 sec latency 384.649 ms 2024-09-10T23:22:06.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206223 29.18 MB/sec execute 242 sec latency 1351.077 ms 2024-09-10T23:22:07.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:06 smithi046 ceph-mon[28128]: pgmap v850: 129 pgs: 129 active+clean; 426 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.6 MiB/s wr, 171 op/s 2024-09-10T23:22:07.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:06 smithi073 ceph-mon[35473]: pgmap v850: 129 pgs: 129 active+clean; 426 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.6 MiB/s wr, 171 op/s 2024-09-10T23:22:07.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41918 5.96 MB/sec execute 245 sec latency 405.390 ms 2024-09-10T23:22:07.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206245 29.06 MB/sec execute 243 sec latency 1376.424 ms 2024-09-10T23:22:08.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 41995 5.95 MB/sec execute 246 sec latency 445.575 ms 2024-09-10T23:22:08.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206245 28.94 MB/sec execute 244 sec latency 1259.059 ms 2024-09-10T23:22:09.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:08 smithi046 ceph-mon[28128]: pgmap v851: 129 pgs: 129 active+clean; 429 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.4 MiB/s wr, 126 op/s 2024-09-10T23:22:09.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:08 smithi073 ceph-mon[35473]: pgmap v851: 129 pgs: 129 active+clean; 429 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.4 MiB/s wr, 126 op/s 2024-09-10T23:22:09.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42080 5.95 MB/sec execute 247 sec latency 477.532 ms 2024-09-10T23:22:09.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206271 28.83 MB/sec execute 245 sec latency 1309.009 ms 2024-09-10T23:22:10.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42210 5.98 MB/sec execute 248 sec latency 321.832 ms 2024-09-10T23:22:10.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206276 28.71 MB/sec execute 246 sec latency 1385.870 ms 2024-09-10T23:22:11.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:10 smithi046 ceph-mon[28128]: pgmap v852: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 MiB/s wr, 107 op/s 2024-09-10T23:22:11.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:10 smithi073 ceph-mon[35473]: pgmap v852: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 MiB/s wr, 107 op/s 2024-09-10T23:22:11.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42348 6.00 MB/sec execute 249 sec latency 354.911 ms 2024-09-10T23:22:11.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206367 28.61 MB/sec execute 247 sec latency 1253.601 ms 2024-09-10T23:22:12.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42470 6.00 MB/sec execute 250 sec latency 282.475 ms 2024-09-10T23:22:12.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206373 28.50 MB/sec execute 248 sec latency 1299.589 ms 2024-09-10T23:22:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:12 smithi046 ceph-mon[28128]: pgmap v853: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2024-09-10T23:22:13.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:12 smithi073 ceph-mon[35473]: pgmap v853: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2024-09-10T23:22:13.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42531 6.00 MB/sec execute 251 sec latency 359.228 ms 2024-09-10T23:22:13.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206463 28.41 MB/sec execute 249 sec latency 1609.580 ms 2024-09-10T23:22:14.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42576 5.98 MB/sec execute 252 sec latency 322.400 ms 2024-09-10T23:22:14.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206465 28.29 MB/sec execute 250 sec latency 1527.278 ms 2024-09-10T23:22:15.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:14 smithi046 ceph-mon[28128]: pgmap v854: 129 pgs: 129 active+clean; 441 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.8 KiB/s rd, 2.5 MiB/s wr, 76 op/s 2024-09-10T23:22:15.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:14 smithi073 ceph-mon[35473]: pgmap v854: 129 pgs: 129 active+clean; 441 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.8 KiB/s rd, 2.5 MiB/s wr, 76 op/s 2024-09-10T23:22:15.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42667 5.99 MB/sec execute 253 sec latency 292.374 ms 2024-09-10T23:22:15.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206465 28.18 MB/sec execute 251 sec latency 1334.960 ms 2024-09-10T23:22:16.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42728 5.99 MB/sec execute 254 sec latency 375.743 ms 2024-09-10T23:22:16.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206478 28.07 MB/sec execute 252 sec latency 1468.653 ms 2024-09-10T23:22:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:16 smithi046 ceph-mon[28128]: pgmap v855: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 84 op/s 2024-09-10T23:22:17.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:16 smithi073 ceph-mon[35473]: pgmap v855: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 84 op/s 2024-09-10T23:22:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:17.433 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42816 5.99 MB/sec execute 255 sec latency 548.753 ms 2024-09-10T23:22:17.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206699 27.99 MB/sec execute 253 sec latency 1292.052 ms 2024-09-10T23:22:18.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 42962 6.01 MB/sec execute 256 sec latency 83.564 ms 2024-09-10T23:22:18.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 207973 28.11 MB/sec execute 254 sec latency 110.043 ms 2024-09-10T23:22:19.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:18 smithi046 ceph-mon[28128]: pgmap v856: 129 pgs: 129 active+clean; 446 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-09-10T23:22:19.349 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:18 smithi073 ceph-mon[35473]: pgmap v856: 129 pgs: 129 active+clean; 446 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-09-10T23:22:19.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43091 6.01 MB/sec execute 257 sec latency 93.061 ms 2024-09-10T23:22:19.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 209679 28.42 MB/sec execute 255 sec latency 142.223 ms 2024-09-10T23:22:20.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43183 5.99 MB/sec execute 258 sec latency 110.488 ms 2024-09-10T23:22:20.857 INFO:tasks.workunit.client.0.smithi046.stdout: 10 210011 28.38 MB/sec execute 256 sec latency 175.267 ms 2024-09-10T23:22:21.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:20 smithi046 ceph-mon[28128]: pgmap v857: 129 pgs: 129 active+clean; 446 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.5 MiB/s wr, 69 op/s 2024-09-10T23:22:21.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:20 smithi073 ceph-mon[35473]: pgmap v857: 129 pgs: 129 active+clean; 446 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.5 MiB/s wr, 69 op/s 2024-09-10T23:22:21.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43288 5.98 MB/sec execute 259 sec latency 97.748 ms 2024-09-10T23:22:21.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 210158 28.28 MB/sec execute 257 sec latency 182.447 ms 2024-09-10T23:22:22.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43352 5.96 MB/sec execute 260 sec latency 478.780 ms 2024-09-10T23:22:22.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 210182 28.17 MB/sec execute 258 sec latency 908.763 ms 2024-09-10T23:22:23.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:22 smithi046 ceph-mon[28128]: pgmap v858: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.6 MiB/s wr, 110 op/s 2024-09-10T23:22:23.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:22 smithi073 ceph-mon[35473]: pgmap v858: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.6 MiB/s wr, 110 op/s 2024-09-10T23:22:23.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43420 5.94 MB/sec execute 261 sec latency 518.432 ms 2024-09-10T23:22:23.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 210248 28.08 MB/sec execute 259 sec latency 1142.833 ms 2024-09-10T23:22:24.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43463 5.92 MB/sec execute 262 sec latency 426.961 ms 2024-09-10T23:22:24.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 210272 27.97 MB/sec execute 260 sec latency 1351.171 ms 2024-09-10T23:22:25.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:24 smithi046 ceph-mon[28128]: pgmap v859: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.0 MiB/s wr, 86 op/s 2024-09-10T23:22:25.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:24 smithi073 ceph-mon[35473]: pgmap v859: 129 pgs: 129 active+clean; 451 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.0 MiB/s wr, 86 op/s 2024-09-10T23:22:25.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43532 5.90 MB/sec execute 263 sec latency 481.664 ms 2024-09-10T23:22:25.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 211022 28.00 MB/sec execute 261 sec latency 1138.725 ms 2024-09-10T23:22:26.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43669 5.91 MB/sec execute 264 sec latency 92.692 ms 2024-09-10T23:22:26.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 212290 28.18 MB/sec execute 262 sec latency 181.602 ms 2024-09-10T23:22:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:26 smithi046 ceph-mon[28128]: pgmap v860: 129 pgs: 129 active+clean; 446 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.0 KiB/s rd, 2.7 MiB/s wr, 95 op/s 2024-09-10T23:22:27.371 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:26 smithi073 ceph-mon[35473]: pgmap v860: 129 pgs: 129 active+clean; 446 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.0 KiB/s rd, 2.7 MiB/s wr, 95 op/s 2024-09-10T23:22:27.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43781 5.90 MB/sec execute 265 sec latency 229.681 ms 2024-09-10T23:22:27.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 213334 28.31 MB/sec execute 263 sec latency 168.028 ms 2024-09-10T23:22:28.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 43920 5.90 MB/sec execute 266 sec latency 102.232 ms 2024-09-10T23:22:28.859 INFO:tasks.workunit.client.0.smithi046.stdout: 10 213640 28.25 MB/sec execute 264 sec latency 132.454 ms 2024-09-10T23:22:29.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:28 smithi046 ceph-mon[28128]: pgmap v861: 129 pgs: 129 active+clean; 444 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 115 op/s 2024-09-10T23:22:29.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:28 smithi073 ceph-mon[35473]: pgmap v861: 129 pgs: 129 active+clean; 444 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 115 op/s 2024-09-10T23:22:29.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44083 5.94 MB/sec execute 267 sec latency 97.428 ms 2024-09-10T23:22:29.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 214572 28.30 MB/sec execute 265 sec latency 114.201 ms 2024-09-10T23:22:30.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44246 5.95 MB/sec execute 268 sec latency 103.110 ms 2024-09-10T23:22:30.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 214687 28.20 MB/sec execute 266 sec latency 819.194 ms 2024-09-10T23:22:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:30 smithi046 ceph-mon[28128]: pgmap v862: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 96 op/s 2024-09-10T23:22:31.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:30 smithi073 ceph-mon[35473]: pgmap v862: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 96 op/s 2024-09-10T23:22:31.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44308 5.94 MB/sec execute 269 sec latency 444.594 ms 2024-09-10T23:22:31.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 214955 28.13 MB/sec execute 267 sec latency 1164.208 ms 2024-09-10T23:22:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:32.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44406 5.94 MB/sec execute 270 sec latency 400.286 ms 2024-09-10T23:22:32.858 INFO:tasks.workunit.client.0.smithi046.stdout: 10 215198 28.10 MB/sec execute 268 sec latency 1013.665 ms 2024-09-10T23:22:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:32 smithi046 ceph-mon[28128]: pgmap v863: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.0 KiB/s rd, 3.2 MiB/s wr, 165 op/s 2024-09-10T23:22:33.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:32 smithi073 ceph-mon[35473]: pgmap v863: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.0 KiB/s rd, 3.2 MiB/s wr, 165 op/s 2024-09-10T23:22:33.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44517 5.92 MB/sec execute 271 sec latency 153.290 ms 2024-09-10T23:22:33.859 INFO:tasks.workunit.client.0.smithi046.stdout: 10 216528 28.30 MB/sec execute 269 sec latency 127.771 ms 2024-09-10T23:22:34.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:33 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:34.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:33 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:34.434 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44651 5.91 MB/sec execute 272 sec latency 83.263 ms 2024-09-10T23:22:34.859 INFO:tasks.workunit.client.0.smithi046.stdout: 10 217170 28.32 MB/sec execute 270 sec latency 117.245 ms 2024-09-10T23:22:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:34 smithi046 ceph-mon[28128]: pgmap v864: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2024-09-10T23:22:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:34 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:22:35.332 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:34 smithi073 ceph-mon[35473]: pgmap v864: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2024-09-10T23:22:35.332 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:35.333 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:35.333 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:34 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:22:35.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44808 5.90 MB/sec execute 273 sec latency 80.330 ms 2024-09-10T23:22:35.859 INFO:tasks.workunit.client.0.smithi046.stdout: 10 217539 28.28 MB/sec execute 271 sec latency 125.793 ms 2024-09-10T23:22:36.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 44967 5.91 MB/sec execute 274 sec latency 104.939 ms 2024-09-10T23:22:36.859 INFO:tasks.workunit.client.0.smithi046.stdout: 10 218538 28.32 MB/sec execute 272 sec latency 268.401 ms 2024-09-10T23:22:37.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:36 smithi046 ceph-mon[28128]: pgmap v865: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.3 KiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-09-10T23:22:37.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:36 smithi073 ceph-mon[35473]: pgmap v865: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.3 KiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-09-10T23:22:37.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45102 5.91 MB/sec execute 275 sec latency 88.378 ms 2024-09-10T23:22:37.859 INFO:tasks.workunit.client.0.smithi046.stdout: 10 219467 28.46 MB/sec execute 273 sec latency 180.708 ms 2024-09-10T23:22:38.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45191 5.90 MB/sec execute 276 sec latency 421.667 ms 2024-09-10T23:22:38.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 219634 28.39 MB/sec execute 274 sec latency 1043.561 ms 2024-09-10T23:22:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:38 smithi046 ceph-mon[28128]: pgmap v866: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.3 MiB/s wr, 162 op/s 2024-09-10T23:22:39.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:38 smithi073 ceph-mon[35473]: pgmap v866: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.3 MiB/s wr, 162 op/s 2024-09-10T23:22:39.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45254 5.90 MB/sec execute 277 sec latency 427.999 ms 2024-09-10T23:22:39.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 219642 28.28 MB/sec execute 275 sec latency 1413.335 ms 2024-09-10T23:22:40.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45318 5.88 MB/sec execute 278 sec latency 421.971 ms 2024-09-10T23:22:40.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 220393 28.35 MB/sec execute 276 sec latency 1443.718 ms 2024-09-10T23:22:41.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:40 smithi046 ceph-mon[28128]: pgmap v867: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.0 MiB/s wr, 136 op/s 2024-09-10T23:22:41.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:40 smithi073 ceph-mon[35473]: pgmap v867: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.0 MiB/s wr, 136 op/s 2024-09-10T23:22:41.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45477 5.91 MB/sec execute 279 sec latency 107.093 ms 2024-09-10T23:22:41.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 220739 28.30 MB/sec execute 277 sec latency 195.698 ms 2024-09-10T23:22:42.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45646 5.94 MB/sec execute 280 sec latency 108.496 ms 2024-09-10T23:22:42.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 220929 28.23 MB/sec execute 278 sec latency 359.193 ms 2024-09-10T23:22:43.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:42 smithi046 ceph-mon[28128]: pgmap v868: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.0 MiB/s wr, 170 op/s 2024-09-10T23:22:43.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:42 smithi073 ceph-mon[35473]: pgmap v868: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.0 MiB/s wr, 170 op/s 2024-09-10T23:22:43.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45870 5.99 MB/sec execute 281 sec latency 86.665 ms 2024-09-10T23:22:43.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 222109 28.31 MB/sec execute 279 sec latency 143.793 ms 2024-09-10T23:22:44.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 45997 5.99 MB/sec execute 282 sec latency 96.063 ms 2024-09-10T23:22:44.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 223189 28.46 MB/sec execute 280 sec latency 156.624 ms 2024-09-10T23:22:45.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:44 smithi046 ceph-mon[28128]: pgmap v869: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.9 MiB/s wr, 101 op/s 2024-09-10T23:22:45.332 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:44 smithi073 ceph-mon[35473]: pgmap v869: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.9 MiB/s wr, 101 op/s 2024-09-10T23:22:45.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46108 6.00 MB/sec execute 283 sec latency 98.678 ms 2024-09-10T23:22:45.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 224148 28.56 MB/sec execute 281 sec latency 128.048 ms 2024-09-10T23:22:46.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46209 6.01 MB/sec execute 284 sec latency 82.298 ms 2024-09-10T23:22:46.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 224396 28.49 MB/sec execute 282 sec latency 170.305 ms 2024-09-10T23:22:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:46 smithi046 ceph-mon[28128]: pgmap v870: 129 pgs: 129 active+clean; 454 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.1 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2024-09-10T23:22:47.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:46 smithi073 ceph-mon[35473]: pgmap v870: 129 pgs: 129 active+clean; 454 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.1 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2024-09-10T23:22:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:22:47.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46338 6.03 MB/sec execute 285 sec latency 76.566 ms 2024-09-10T23:22:47.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 225458 28.55 MB/sec execute 283 sec latency 212.333 ms 2024-09-10T23:22:48.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46483 6.05 MB/sec execute 286 sec latency 106.477 ms 2024-09-10T23:22:48.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 226701 28.73 MB/sec execute 284 sec latency 126.394 ms 2024-09-10T23:22:49.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:48 smithi046 ceph-mon[28128]: pgmap v871: 129 pgs: 129 active+clean; 460 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-10T23:22:49.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:48 smithi073 ceph-mon[35473]: pgmap v871: 129 pgs: 129 active+clean; 460 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-10T23:22:49.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46601 6.04 MB/sec execute 287 sec latency 123.172 ms 2024-09-10T23:22:49.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 227603 28.81 MB/sec execute 285 sec latency 114.240 ms 2024-09-10T23:22:50.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46714 6.03 MB/sec execute 288 sec latency 99.251 ms 2024-09-10T23:22:50.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 227931 28.76 MB/sec execute 286 sec latency 119.763 ms 2024-09-10T23:22:51.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:50 smithi046 ceph-mon[28128]: pgmap v872: 129 pgs: 129 active+clean; 461 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.4 MiB/s wr, 99 op/s 2024-09-10T23:22:51.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:50 smithi073 ceph-mon[35473]: pgmap v872: 129 pgs: 129 active+clean; 461 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.4 MiB/s wr, 99 op/s 2024-09-10T23:22:51.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46813 6.02 MB/sec execute 289 sec latency 90.711 ms 2024-09-10T23:22:51.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 228744 28.79 MB/sec execute 287 sec latency 226.156 ms 2024-09-10T23:22:52.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 46918 6.00 MB/sec execute 290 sec latency 133.270 ms 2024-09-10T23:22:52.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 229654 28.88 MB/sec execute 288 sec latency 321.023 ms 2024-09-10T23:22:53.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:52 smithi046 ceph-mon[28128]: pgmap v873: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 145 op/s 2024-09-10T23:22:53.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:52 smithi073 ceph-mon[35473]: pgmap v873: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 145 op/s 2024-09-10T23:22:53.435 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47030 5.99 MB/sec execute 291 sec latency 116.380 ms 2024-09-10T23:22:53.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 230813 29.01 MB/sec execute 289 sec latency 561.623 ms 2024-09-10T23:22:54.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47105 5.97 MB/sec execute 292 sec latency 387.985 ms 2024-09-10T23:22:54.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 231352 29.01 MB/sec execute 290 sec latency 126.125 ms 2024-09-10T23:22:55.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:54 smithi046 ceph-mon[28128]: pgmap v874: 129 pgs: 129 active+clean; 454 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.7 MiB/s wr, 106 op/s 2024-09-10T23:22:55.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:54 smithi073 ceph-mon[35473]: pgmap v874: 129 pgs: 129 active+clean; 454 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.7 MiB/s wr, 106 op/s 2024-09-10T23:22:55.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47239 5.98 MB/sec execute 293 sec latency 125.463 ms 2024-09-10T23:22:55.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 231555 28.93 MB/sec execute 291 sec latency 259.667 ms 2024-09-10T23:22:56.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47360 5.97 MB/sec execute 294 sec latency 187.807 ms 2024-09-10T23:22:56.860 INFO:tasks.workunit.client.0.smithi046.stdout: 10 232166 28.95 MB/sec execute 292 sec latency 637.393 ms 2024-09-10T23:22:57.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:56 smithi046 ceph-mon[28128]: pgmap v875: 129 pgs: 129 active+clean; 444 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 4.0 MiB/s wr, 126 op/s 2024-09-10T23:22:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:56 smithi073 ceph-mon[35473]: pgmap v875: 129 pgs: 129 active+clean; 444 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 4.0 MiB/s wr, 126 op/s 2024-09-10T23:22:57.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47511 5.98 MB/sec execute 295 sec latency 94.674 ms 2024-09-10T23:22:57.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 233465 29.10 MB/sec execute 293 sec latency 131.708 ms 2024-09-10T23:22:58.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47678 6.00 MB/sec execute 296 sec latency 109.703 ms 2024-09-10T23:22:58.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 234651 29.22 MB/sec execute 294 sec latency 140.192 ms 2024-09-10T23:22:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:22:58 smithi046 ceph-mon[28128]: pgmap v876: 129 pgs: 129 active+clean; 430 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.5 MiB/s wr, 131 op/s 2024-09-10T23:22:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:22:58 smithi073 ceph-mon[35473]: pgmap v876: 129 pgs: 129 active+clean; 430 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.5 MiB/s wr, 131 op/s 2024-09-10T23:22:59.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47826 6.01 MB/sec execute 297 sec latency 115.880 ms 2024-09-10T23:22:59.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 234975 29.17 MB/sec execute 295 sec latency 111.746 ms 2024-09-10T23:23:00.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 47976 6.02 MB/sec execute 298 sec latency 94.938 ms 2024-09-10T23:23:00.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 235821 29.21 MB/sec execute 296 sec latency 121.162 ms 2024-09-10T23:23:01.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:00 smithi046 ceph-mon[28128]: pgmap v877: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 2.9 MiB/s wr, 127 op/s 2024-09-10T23:23:01.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:00 smithi073 ceph-mon[35473]: pgmap v877: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 2.9 MiB/s wr, 127 op/s 2024-09-10T23:23:01.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48091 6.01 MB/sec execute 299 sec latency 185.887 ms 2024-09-10T23:23:01.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 236324 29.18 MB/sec execute 297 sec latency 602.956 ms 2024-09-10T23:23:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:02.333 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:02.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48237 6.00 MB/sec execute 300 sec latency 180.243 ms 2024-09-10T23:23:02.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 237526 29.34 MB/sec execute 298 sec latency 620.566 ms 2024-09-10T23:23:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:02 smithi046 ceph-mon[28128]: pgmap v878: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 190 op/s 2024-09-10T23:23:03.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:02 smithi073 ceph-mon[35473]: pgmap v878: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 190 op/s 2024-09-10T23:23:03.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48389 5.99 MB/sec execute 301 sec latency 78.553 ms 2024-09-10T23:23:03.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 238252 29.38 MB/sec execute 299 sec latency 143.336 ms 2024-09-10T23:23:04.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48550 6.00 MB/sec execute 302 sec latency 95.764 ms 2024-09-10T23:23:04.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 238676 29.34 MB/sec execute 300 sec latency 108.698 ms 2024-09-10T23:23:05.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:04 smithi046 ceph-mon[28128]: pgmap v879: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-10T23:23:05.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:04 smithi073 ceph-mon[35473]: pgmap v879: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-10T23:23:05.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48689 6.00 MB/sec execute 303 sec latency 81.142 ms 2024-09-10T23:23:05.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 239842 29.42 MB/sec execute 301 sec latency 150.618 ms 2024-09-10T23:23:06.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48836 6.01 MB/sec execute 304 sec latency 91.607 ms 2024-09-10T23:23:06.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 240913 29.55 MB/sec execute 302 sec latency 142.917 ms 2024-09-10T23:23:07.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:06 smithi046 ceph-mon[28128]: pgmap v880: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 2.5 MiB/s wr, 167 op/s 2024-09-10T23:23:07.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:06 smithi073 ceph-mon[35473]: pgmap v880: 129 pgs: 129 active+clean; 429 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 2.5 MiB/s wr, 167 op/s 2024-09-10T23:23:07.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 48938 6.02 MB/sec execute 305 sec latency 285.382 ms 2024-09-10T23:23:07.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 241254 29.52 MB/sec execute 303 sec latency 946.122 ms 2024-09-10T23:23:08.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49084 6.04 MB/sec execute 306 sec latency 398.761 ms 2024-09-10T23:23:08.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 241997 29.56 MB/sec execute 304 sec latency 726.185 ms 2024-09-10T23:23:09.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:08 smithi046 ceph-mon[28128]: pgmap v881: 129 pgs: 129 active+clean; 433 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 2.7 MiB/s wr, 182 op/s 2024-09-10T23:23:09.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:08 smithi073 ceph-mon[35473]: pgmap v881: 129 pgs: 129 active+clean; 433 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 2.7 MiB/s wr, 182 op/s 2024-09-10T23:23:09.436 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49280 6.06 MB/sec execute 307 sec latency 147.703 ms 2024-09-10T23:23:09.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 242392 29.53 MB/sec execute 305 sec latency 123.687 ms 2024-09-10T23:23:10.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:10 smithi046 ceph-mon[28128]: pgmap v882: 129 pgs: 129 active+clean; 436 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 2.7 MiB/s wr, 145 op/s 2024-09-10T23:23:10.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:10 smithi073 ceph-mon[35473]: pgmap v882: 129 pgs: 129 active+clean; 436 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 2.7 MiB/s wr, 145 op/s 2024-09-10T23:23:10.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49470 6.10 MB/sec execute 308 sec latency 92.742 ms 2024-09-10T23:23:10.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 243529 29.60 MB/sec execute 306 sec latency 163.225 ms 2024-09-10T23:23:11.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49605 6.10 MB/sec execute 309 sec latency 109.942 ms 2024-09-10T23:23:11.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 244826 29.76 MB/sec execute 307 sec latency 158.893 ms 2024-09-10T23:23:12.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49677 6.09 MB/sec execute 310 sec latency 113.576 ms 2024-09-10T23:23:12.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:12 smithi046 ceph-mon[28128]: pgmap v883: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 181 op/s 2024-09-10T23:23:12.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:12 smithi073 ceph-mon[35473]: pgmap v883: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 181 op/s 2024-09-10T23:23:12.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245334 29.76 MB/sec execute 308 sec latency 242.623 ms 2024-09-10T23:23:13.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49782 6.11 MB/sec execute 311 sec latency 129.067 ms 2024-09-10T23:23:13.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245545 29.70 MB/sec execute 309 sec latency 838.162 ms 2024-09-10T23:23:14.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49830 6.10 MB/sec execute 312 sec latency 438.566 ms 2024-09-10T23:23:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:14 smithi046 ceph-mon[28128]: pgmap v884: 129 pgs: 129 active+clean; 448 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.0 MiB/s wr, 117 op/s 2024-09-10T23:23:14.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:14 smithi073 ceph-mon[35473]: pgmap v884: 129 pgs: 129 active+clean; 448 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.0 MiB/s wr, 117 op/s 2024-09-10T23:23:14.861 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245547 29.60 MB/sec execute 310 sec latency 1429.257 ms 2024-09-10T23:23:15.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49898 6.10 MB/sec execute 313 sec latency 528.483 ms 2024-09-10T23:23:15.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245554 29.51 MB/sec execute 311 sec latency 1186.856 ms 2024-09-10T23:23:16.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 49931 6.09 MB/sec execute 314 sec latency 451.180 ms 2024-09-10T23:23:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:16 smithi046 ceph-mon[28128]: pgmap v885: 129 pgs: 129 active+clean; 451 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 122 op/s 2024-09-10T23:23:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:16 smithi073 ceph-mon[35473]: pgmap v885: 129 pgs: 129 active+clean; 451 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 122 op/s 2024-09-10T23:23:16.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245556 29.42 MB/sec execute 312 sec latency 1358.802 ms 2024-09-10T23:23:17.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50026 6.09 MB/sec execute 315 sec latency 421.468 ms 2024-09-10T23:23:17.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:17.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:17.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245568 29.32 MB/sec execute 313 sec latency 1442.313 ms 2024-09-10T23:23:18.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50088 6.09 MB/sec execute 316 sec latency 400.060 ms 2024-09-10T23:23:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:18 smithi046 ceph-mon[28128]: pgmap v886: 129 pgs: 129 active+clean; 453 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.9 MiB/s wr, 123 op/s 2024-09-10T23:23:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:18 smithi073 ceph-mon[35473]: pgmap v886: 129 pgs: 129 active+clean; 453 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.9 MiB/s wr, 123 op/s 2024-09-10T23:23:18.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245577 29.23 MB/sec execute 314 sec latency 1221.076 ms 2024-09-10T23:23:19.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50155 6.07 MB/sec execute 317 sec latency 533.494 ms 2024-09-10T23:23:19.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245578 29.14 MB/sec execute 315 sec latency 1048.408 ms 2024-09-10T23:23:20.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50194 6.06 MB/sec execute 318 sec latency 448.895 ms 2024-09-10T23:23:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:20 smithi046 ceph-mon[28128]: pgmap v887: 129 pgs: 129 active+clean; 452 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.4 MiB/s wr, 88 op/s 2024-09-10T23:23:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:20 smithi073 ceph-mon[35473]: pgmap v887: 129 pgs: 129 active+clean; 452 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.4 MiB/s wr, 88 op/s 2024-09-10T23:23:20.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245594 29.05 MB/sec execute 316 sec latency 1350.503 ms 2024-09-10T23:23:21.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50255 6.05 MB/sec execute 319 sec latency 496.580 ms 2024-09-10T23:23:21.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245621 28.96 MB/sec execute 317 sec latency 1356.980 ms 2024-09-10T23:23:22.437 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50291 6.03 MB/sec execute 320 sec latency 465.160 ms 2024-09-10T23:23:22.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:22 smithi046 ceph-mon[28128]: pgmap v888: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.7 MiB/s wr, 111 op/s 2024-09-10T23:23:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:22 smithi073 ceph-mon[35473]: pgmap v888: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.7 MiB/s wr, 111 op/s 2024-09-10T23:23:22.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245631 28.87 MB/sec execute 318 sec latency 1381.702 ms 2024-09-10T23:23:23.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50338 6.01 MB/sec execute 321 sec latency 443.455 ms 2024-09-10T23:23:23.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245648 28.78 MB/sec execute 319 sec latency 1085.193 ms 2024-09-10T23:23:24.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50372 6.00 MB/sec execute 322 sec latency 480.067 ms 2024-09-10T23:23:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:24 smithi046 ceph-mon[28128]: pgmap v889: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 2.4 MiB/s wr, 68 op/s 2024-09-10T23:23:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:24 smithi073 ceph-mon[35473]: pgmap v889: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 2.4 MiB/s wr, 68 op/s 2024-09-10T23:23:24.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245654 28.69 MB/sec execute 320 sec latency 1356.189 ms 2024-09-10T23:23:25.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50446 5.98 MB/sec execute 323 sec latency 317.244 ms 2024-09-10T23:23:25.862 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245682 28.60 MB/sec execute 321 sec latency 1351.277 ms 2024-09-10T23:23:26.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50505 5.97 MB/sec execute 324 sec latency 397.707 ms 2024-09-10T23:23:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:26 smithi046 ceph-mon[28128]: pgmap v890: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.4 MiB/s wr, 72 op/s 2024-09-10T23:23:26.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:26 smithi073 ceph-mon[35473]: pgmap v890: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.4 MiB/s wr, 72 op/s 2024-09-10T23:23:26.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245744 28.52 MB/sec execute 322 sec latency 1102.763 ms 2024-09-10T23:23:27.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50562 5.95 MB/sec execute 325 sec latency 728.239 ms 2024-09-10T23:23:27.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245772 28.44 MB/sec execute 323 sec latency 1148.649 ms 2024-09-10T23:23:28.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50582 5.93 MB/sec execute 326 sec latency 1216.847 ms 2024-09-10T23:23:28.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:28 smithi046 ceph-mon[28128]: pgmap v891: 129 pgs: 129 active+clean; 458 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-10T23:23:28.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:28 smithi073 ceph-mon[35473]: pgmap v891: 129 pgs: 129 active+clean; 458 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-10T23:23:28.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 245873 28.38 MB/sec execute 324 sec latency 1409.330 ms 2024-09-10T23:23:29.438 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50695 5.93 MB/sec execute 327 sec latency 184.764 ms 2024-09-10T23:23:29.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 246955 28.43 MB/sec execute 325 sec latency 843.006 ms 2024-09-10T23:23:30.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50839 5.93 MB/sec execute 328 sec latency 85.556 ms 2024-09-10T23:23:30.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:30 smithi046 ceph-mon[28128]: pgmap v892: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-10T23:23:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:30 smithi073 ceph-mon[35473]: pgmap v892: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-10T23:23:30.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 247883 28.53 MB/sec execute 326 sec latency 361.939 ms 2024-09-10T23:23:31.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 50980 5.93 MB/sec execute 329 sec latency 97.381 ms 2024-09-10T23:23:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:31.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:31.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 248875 28.62 MB/sec execute 327 sec latency 134.710 ms 2024-09-10T23:23:32.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51152 5.96 MB/sec execute 330 sec latency 106.354 ms 2024-09-10T23:23:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:32 smithi046 ceph-mon[28128]: pgmap v893: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-09-10T23:23:32.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:32 smithi073 ceph-mon[35473]: pgmap v893: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-09-10T23:23:32.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 249192 28.57 MB/sec execute 328 sec latency 150.511 ms 2024-09-10T23:23:33.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51318 5.97 MB/sec execute 331 sec latency 80.597 ms 2024-09-10T23:23:33.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 249923 28.60 MB/sec execute 329 sec latency 376.177 ms 2024-09-10T23:23:34.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51388 5.96 MB/sec execute 332 sec latency 459.850 ms 2024-09-10T23:23:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:34 smithi046 ceph-mon[28128]: pgmap v894: 129 pgs: 129 active+clean; 448 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-10T23:23:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:34 smithi073 ceph-mon[35473]: pgmap v894: 129 pgs: 129 active+clean; 448 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-10T23:23:34.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 249977 28.51 MB/sec execute 330 sec latency 1210.369 ms 2024-09-10T23:23:35.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51430 5.94 MB/sec execute 333 sec latency 458.904 ms 2024-09-10T23:23:35.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 250103 28.44 MB/sec execute 331 sec latency 1359.235 ms 2024-09-10T23:23:36.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51529 5.95 MB/sec execute 334 sec latency 452.699 ms 2024-09-10T23:23:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:36 smithi046 ceph-mon[28128]: pgmap v895: 129 pgs: 129 active+clean; 442 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2024-09-10T23:23:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:36 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:36 smithi073 ceph-mon[35473]: pgmap v895: 129 pgs: 129 active+clean; 442 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2024-09-10T23:23:36.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:36 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:36.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 251148 28.56 MB/sec execute 332 sec latency 637.827 ms 2024-09-10T23:23:37.441 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51660 5.93 MB/sec execute 335 sec latency 86.951 ms 2024-09-10T23:23:37.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 252273 28.65 MB/sec execute 333 sec latency 149.992 ms 2024-09-10T23:23:38.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51803 5.93 MB/sec execute 336 sec latency 81.419 ms 2024-09-10T23:23:38.682 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:38 smithi046 ceph-mon[28128]: pgmap v896: 129 pgs: 129 active+clean; 444 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 2.2 MiB/s wr, 276 op/s 2024-09-10T23:23:38.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:38 smithi073 ceph-mon[35473]: pgmap v896: 129 pgs: 129 active+clean; 444 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 2.2 MiB/s wr, 276 op/s 2024-09-10T23:23:38.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 252450 28.59 MB/sec execute 334 sec latency 242.583 ms 2024-09-10T23:23:39.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 51930 5.92 MB/sec execute 337 sec latency 151.009 ms 2024-09-10T23:23:39.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 252957 28.59 MB/sec execute 335 sec latency 112.584 ms 2024-09-10T23:23:40.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52079 5.92 MB/sec execute 338 sec latency 80.320 ms 2024-09-10T23:23:40.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:40 smithi046 ceph-mon[28128]: pgmap v897: 129 pgs: 129 active+clean; 444 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-10T23:23:40.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:40 smithi073 ceph-mon[35473]: pgmap v897: 129 pgs: 129 active+clean; 444 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-10T23:23:40.863 INFO:tasks.workunit.client.0.smithi046.stdout: 10 253827 28.60 MB/sec execute 336 sec latency 234.655 ms 2024-09-10T23:23:41.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52185 5.92 MB/sec execute 339 sec latency 264.648 ms 2024-09-10T23:23:41.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 253865 28.52 MB/sec execute 337 sec latency 1075.385 ms 2024-09-10T23:23:42.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:41 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:23:42.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:23:42.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:41 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:23:42.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52264 5.91 MB/sec execute 340 sec latency 438.286 ms 2024-09-10T23:23:42.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:42 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:23:42.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 253943 28.45 MB/sec execute 338 sec latency 1352.493 ms 2024-09-10T23:23:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:42 smithi046 ceph-mon[28128]: pgmap v898: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.3 MiB/s wr, 283 op/s 2024-09-10T23:23:43.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:42 smithi073 ceph-mon[35473]: pgmap v898: 129 pgs: 129 active+clean; 446 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.3 MiB/s wr, 283 op/s 2024-09-10T23:23:43.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52340 5.91 MB/sec execute 341 sec latency 471.808 ms 2024-09-10T23:23:43.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 254921 28.56 MB/sec execute 339 sec latency 1151.934 ms 2024-09-10T23:23:44.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52473 5.92 MB/sec execute 342 sec latency 87.447 ms 2024-09-10T23:23:44.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 255910 28.64 MB/sec execute 340 sec latency 121.557 ms 2024-09-10T23:23:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:44 smithi046 ceph-mon[28128]: pgmap v899: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-09-10T23:23:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:44 smithi073 ceph-mon[35473]: pgmap v899: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-09-10T23:23:45.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52641 5.95 MB/sec execute 343 sec latency 101.959 ms 2024-09-10T23:23:45.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 256226 28.60 MB/sec execute 341 sec latency 241.827 ms 2024-09-10T23:23:46.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 52843 5.97 MB/sec execute 344 sec latency 93.970 ms 2024-09-10T23:23:46.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 256822 28.60 MB/sec execute 342 sec latency 143.788 ms 2024-09-10T23:23:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:46 smithi046 ceph-mon[28128]: pgmap v900: 129 pgs: 129 active+clean; 452 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.0 KiB/s rd, 2.4 MiB/s wr, 138 op/s 2024-09-10T23:23:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:46 smithi073 ceph-mon[35473]: pgmap v900: 129 pgs: 129 active+clean; 452 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.0 KiB/s rd, 2.4 MiB/s wr, 138 op/s 2024-09-10T23:23:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:23:47.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53033 6.00 MB/sec execute 345 sec latency 103.518 ms 2024-09-10T23:23:47.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 257796 28.66 MB/sec execute 343 sec latency 142.876 ms 2024-09-10T23:23:48.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53113 6.00 MB/sec execute 346 sec latency 250.720 ms 2024-09-10T23:23:48.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 257880 28.60 MB/sec execute 344 sec latency 817.296 ms 2024-09-10T23:23:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:48 smithi073 ceph-mon[35473]: pgmap v901: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.6 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-09-10T23:23:49.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:48 smithi046 ceph-mon[28128]: pgmap v901: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.6 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-09-10T23:23:49.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53170 5.99 MB/sec execute 347 sec latency 404.864 ms 2024-09-10T23:23:49.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 257939 28.52 MB/sec execute 345 sec latency 1093.320 ms 2024-09-10T23:23:50.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53205 5.97 MB/sec execute 348 sec latency 493.249 ms 2024-09-10T23:23:50.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 258477 28.54 MB/sec execute 346 sec latency 1302.201 ms 2024-09-10T23:23:51.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:50 smithi073 ceph-mon[35473]: pgmap v902: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.6 KiB/s rd, 2.6 MiB/s wr, 99 op/s 2024-09-10T23:23:51.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:50 smithi046 ceph-mon[28128]: pgmap v902: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.6 KiB/s rd, 2.6 MiB/s wr, 99 op/s 2024-09-10T23:23:51.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53304 5.99 MB/sec execute 349 sec latency 102.403 ms 2024-09-10T23:23:51.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 259410 28.61 MB/sec execute 347 sec latency 171.906 ms 2024-09-10T23:23:52.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53428 6.00 MB/sec execute 350 sec latency 93.177 ms 2024-09-10T23:23:52.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 259739 28.57 MB/sec execute 348 sec latency 142.681 ms 2024-09-10T23:23:53.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:52 smithi046 ceph-mon[28128]: pgmap v903: 129 pgs: 129 active+clean; 467 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.8 KiB/s rd, 3.6 MiB/s wr, 130 op/s 2024-09-10T23:23:53.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:52 smithi073 ceph-mon[35473]: pgmap v903: 129 pgs: 129 active+clean; 467 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.8 KiB/s rd, 3.6 MiB/s wr, 130 op/s 2024-09-10T23:23:53.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53547 6.00 MB/sec execute 351 sec latency 90.937 ms 2024-09-10T23:23:53.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 260046 28.53 MB/sec execute 349 sec latency 195.011 ms 2024-09-10T23:23:54.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53689 6.01 MB/sec execute 352 sec latency 98.555 ms 2024-09-10T23:23:54.864 INFO:tasks.workunit.client.0.smithi046.stdout: 10 260872 28.55 MB/sec execute 350 sec latency 210.965 ms 2024-09-10T23:23:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:54 smithi046 ceph-mon[28128]: pgmap v904: 129 pgs: 129 active+clean; 468 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.2 MiB/s wr, 88 op/s 2024-09-10T23:23:55.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:54 smithi073 ceph-mon[35473]: pgmap v904: 129 pgs: 129 active+clean; 468 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.2 MiB/s wr, 88 op/s 2024-09-10T23:23:55.442 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53796 6.01 MB/sec execute 353 sec latency 122.627 ms 2024-09-10T23:23:55.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 261618 28.61 MB/sec execute 351 sec latency 366.990 ms 2024-09-10T23:23:56.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53860 5.99 MB/sec execute 354 sec latency 280.696 ms 2024-09-10T23:23:56.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 261668 28.54 MB/sec execute 352 sec latency 1091.860 ms 2024-09-10T23:23:57.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:56 smithi046 ceph-mon[28128]: pgmap v905: 129 pgs: 129 active+clean; 464 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 4.0 MiB/s wr, 121 op/s 2024-09-10T23:23:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:56 smithi073 ceph-mon[35473]: pgmap v905: 129 pgs: 129 active+clean; 464 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 4.0 MiB/s wr, 121 op/s 2024-09-10T23:23:57.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53898 5.98 MB/sec execute 355 sec latency 515.860 ms 2024-09-10T23:23:57.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 261703 28.46 MB/sec execute 353 sec latency 1168.549 ms 2024-09-10T23:23:58.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 53949 5.96 MB/sec execute 356 sec latency 523.088 ms 2024-09-10T23:23:58.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 262209 28.46 MB/sec execute 354 sec latency 1331.035 ms 2024-09-10T23:23:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:23:58 smithi046 ceph-mon[28128]: pgmap v906: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.8 MiB/s wr, 103 op/s 2024-09-10T23:23:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:23:58 smithi073 ceph-mon[35473]: pgmap v906: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.8 MiB/s wr, 103 op/s 2024-09-10T23:23:59.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54057 5.95 MB/sec execute 357 sec latency 105.400 ms 2024-09-10T23:23:59.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 263069 28.52 MB/sec execute 355 sec latency 296.194 ms 2024-09-10T23:24:00.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54173 5.95 MB/sec execute 358 sec latency 140.123 ms 2024-09-10T23:24:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:00 smithi046 ceph-mon[28128]: pgmap v907: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2024-09-10T23:24:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:24:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:24:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:00.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:00.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:00 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:24:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:00 smithi073 ceph-mon[35473]: pgmap v907: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2024-09-10T23:24:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:24:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:24:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:00.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:00.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:00 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:24:00.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 263391 28.47 MB/sec execute 356 sec latency 256.224 ms 2024-09-10T23:24:01.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54298 5.94 MB/sec execute 359 sec latency 110.543 ms 2024-09-10T23:24:01.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:01.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:01.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 264381 28.52 MB/sec execute 357 sec latency 289.380 ms 2024-09-10T23:24:02.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54422 5.94 MB/sec execute 360 sec latency 105.023 ms 2024-09-10T23:24:02.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:02 smithi046 ceph-mon[28128]: pgmap v908: 129 pgs: 129 active+clean; 448 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 126 op/s 2024-09-10T23:24:02.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:02 smithi073 ceph-mon[35473]: pgmap v908: 129 pgs: 129 active+clean; 448 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 126 op/s 2024-09-10T23:24:02.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 265366 28.63 MB/sec execute 358 sec latency 141.167 ms 2024-09-10T23:24:03.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54502 5.94 MB/sec execute 361 sec latency 497.987 ms 2024-09-10T23:24:03.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 266499 28.72 MB/sec execute 359 sec latency 130.889 ms 2024-09-10T23:24:04.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54644 5.94 MB/sec execute 362 sec latency 568.834 ms 2024-09-10T23:24:04.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:04 smithi046 ceph-mon[28128]: pgmap v909: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.4 MiB/s wr, 94 op/s 2024-09-10T23:24:04.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:04 smithi073 ceph-mon[35473]: pgmap v909: 129 pgs: 129 active+clean; 447 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.4 MiB/s wr, 94 op/s 2024-09-10T23:24:04.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 266837 28.68 MB/sec execute 360 sec latency 144.066 ms 2024-09-10T23:24:05.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54824 5.97 MB/sec execute 363 sec latency 115.131 ms 2024-09-10T23:24:05.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 267353 28.67 MB/sec execute 361 sec latency 194.205 ms 2024-09-10T23:24:06.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 54946 5.96 MB/sec execute 364 sec latency 120.871 ms 2024-09-10T23:24:06.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:06 smithi046 ceph-mon[28128]: pgmap v910: 129 pgs: 129 active+clean; 437 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.9 KiB/s rd, 3.0 MiB/s wr, 130 op/s 2024-09-10T23:24:06.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:06 smithi073 ceph-mon[35473]: pgmap v910: 129 pgs: 129 active+clean; 437 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.9 KiB/s rd, 3.0 MiB/s wr, 130 op/s 2024-09-10T23:24:06.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 268264 28.72 MB/sec execute 362 sec latency 388.684 ms 2024-09-10T23:24:07.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55088 5.97 MB/sec execute 365 sec latency 105.440 ms 2024-09-10T23:24:07.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 269433 28.83 MB/sec execute 363 sec latency 120.062 ms 2024-09-10T23:24:08.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55230 5.95 MB/sec execute 366 sec latency 83.862 ms 2024-09-10T23:24:08.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:08 smithi046 ceph-mon[28128]: pgmap v911: 129 pgs: 129 active+clean; 435 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 135 op/s 2024-09-10T23:24:08.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:08 smithi073 ceph-mon[35473]: pgmap v911: 129 pgs: 129 active+clean; 435 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 135 op/s 2024-09-10T23:24:08.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 270093 28.85 MB/sec execute 364 sec latency 192.057 ms 2024-09-10T23:24:09.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55384 5.95 MB/sec execute 367 sec latency 71.481 ms 2024-09-10T23:24:09.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 270436 28.82 MB/sec execute 365 sec latency 160.022 ms 2024-09-10T23:24:10.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55546 5.95 MB/sec execute 368 sec latency 80.852 ms 2024-09-10T23:24:10.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:10 smithi046 ceph-mon[28128]: pgmap v912: 129 pgs: 129 active+clean; 435 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-10T23:24:10.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:10 smithi073 ceph-mon[35473]: pgmap v912: 129 pgs: 129 active+clean; 435 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-10T23:24:10.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 271400 28.86 MB/sec execute 366 sec latency 126.342 ms 2024-09-10T23:24:11.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55700 5.95 MB/sec execute 369 sec latency 66.549 ms 2024-09-10T23:24:11.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 272377 28.95 MB/sec execute 367 sec latency 177.622 ms 2024-09-10T23:24:12.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55842 5.95 MB/sec execute 370 sec latency 72.182 ms 2024-09-10T23:24:12.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:12 smithi046 ceph-mon[28128]: pgmap v913: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 2.6 MiB/s wr, 184 op/s 2024-09-10T23:24:12.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:12 smithi073 ceph-mon[35473]: pgmap v913: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 2.6 MiB/s wr, 184 op/s 2024-09-10T23:24:12.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 273591 29.05 MB/sec execute 368 sec latency 122.884 ms 2024-09-10T23:24:13.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 55969 5.96 MB/sec execute 371 sec latency 91.640 ms 2024-09-10T23:24:13.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 273936 29.02 MB/sec execute 369 sec latency 150.801 ms 2024-09-10T23:24:14.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56123 5.98 MB/sec execute 372 sec latency 83.507 ms 2024-09-10T23:24:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:14 smithi046 ceph-mon[28128]: pgmap v914: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.1 MiB/s wr, 149 op/s 2024-09-10T23:24:14.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:14 smithi073 ceph-mon[35473]: pgmap v914: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.1 MiB/s wr, 149 op/s 2024-09-10T23:24:14.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 274650 29.03 MB/sec execute 370 sec latency 129.546 ms 2024-09-10T23:24:15.443 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56321 6.01 MB/sec execute 373 sec latency 77.166 ms 2024-09-10T23:24:15.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 275733 29.11 MB/sec execute 371 sec latency 124.706 ms 2024-09-10T23:24:16.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56539 6.04 MB/sec execute 374 sec latency 107.997 ms 2024-09-10T23:24:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:16 smithi046 ceph-mon[28128]: pgmap v915: 129 pgs: 129 active+clean; 446 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 3.1 MiB/s wr, 188 op/s 2024-09-10T23:24:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:16 smithi073 ceph-mon[35473]: pgmap v915: 129 pgs: 129 active+clean; 446 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 3.1 MiB/s wr, 188 op/s 2024-09-10T23:24:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:16.865 INFO:tasks.workunit.client.0.smithi046.stdout: 10 276737 29.19 MB/sec execute 372 sec latency 289.195 ms 2024-09-10T23:24:17.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56656 6.04 MB/sec execute 375 sec latency 120.741 ms 2024-09-10T23:24:17.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 277346 29.20 MB/sec execute 373 sec latency 132.867 ms 2024-09-10T23:24:18.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56756 6.04 MB/sec execute 376 sec latency 87.984 ms 2024-09-10T23:24:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:18 smithi046 ceph-mon[28128]: pgmap v916: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2024-09-10T23:24:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:18 smithi073 ceph-mon[35473]: pgmap v916: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2024-09-10T23:24:18.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 277625 29.16 MB/sec execute 374 sec latency 352.663 ms 2024-09-10T23:24:19.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56814 6.04 MB/sec execute 377 sec latency 311.314 ms 2024-09-10T23:24:19.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 277770 29.10 MB/sec execute 375 sec latency 958.319 ms 2024-09-10T23:24:20.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 56906 6.05 MB/sec execute 378 sec latency 354.622 ms 2024-09-10T23:24:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:20 smithi046 ceph-mon[28128]: pgmap v917: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.0 MiB/s wr, 124 op/s 2024-09-10T23:24:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:20 smithi073 ceph-mon[35473]: pgmap v917: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.0 MiB/s wr, 124 op/s 2024-09-10T23:24:20.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 278730 29.14 MB/sec execute 376 sec latency 216.539 ms 2024-09-10T23:24:21.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57039 6.06 MB/sec execute 379 sec latency 100.459 ms 2024-09-10T23:24:21.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 279685 29.23 MB/sec execute 377 sec latency 239.244 ms 2024-09-10T23:24:22.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57176 6.07 MB/sec execute 380 sec latency 96.514 ms 2024-09-10T23:24:22.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:22 smithi046 ceph-mon[28128]: pgmap v918: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.1 MiB/s wr, 161 op/s 2024-09-10T23:24:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:22 smithi073 ceph-mon[35473]: pgmap v918: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.1 MiB/s wr, 161 op/s 2024-09-10T23:24:22.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 279719 29.15 MB/sec execute 378 sec latency 1145.405 ms 2024-09-10T23:24:23.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57245 6.06 MB/sec execute 381 sec latency 453.699 ms 2024-09-10T23:24:23.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280228 29.15 MB/sec execute 379 sec latency 1282.113 ms 2024-09-10T23:24:24.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57289 6.04 MB/sec execute 382 sec latency 469.742 ms 2024-09-10T23:24:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:24 smithi046 ceph-mon[28128]: pgmap v919: 129 pgs: 129 active+clean; 460 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 3.6 MiB/s wr, 105 op/s 2024-09-10T23:24:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:24 smithi073 ceph-mon[35473]: pgmap v919: 129 pgs: 129 active+clean; 460 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 3.6 MiB/s wr, 105 op/s 2024-09-10T23:24:24.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280282 29.07 MB/sec execute 380 sec latency 1313.345 ms 2024-09-10T23:24:25.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57375 6.04 MB/sec execute 383 sec latency 458.749 ms 2024-09-10T23:24:25.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280518 29.03 MB/sec execute 381 sec latency 1372.620 ms 2024-09-10T23:24:26.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57436 6.02 MB/sec execute 384 sec latency 397.676 ms 2024-09-10T23:24:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:26 smithi046 ceph-mon[28128]: pgmap v920: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 137 op/s 2024-09-10T23:24:26.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:26 smithi073 ceph-mon[35473]: pgmap v920: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 137 op/s 2024-09-10T23:24:26.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280698 28.99 MB/sec execute 382 sec latency 818.395 ms 2024-09-10T23:24:27.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57529 6.01 MB/sec execute 385 sec latency 164.073 ms 2024-09-10T23:24:27.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280748 28.92 MB/sec execute 383 sec latency 1086.278 ms 2024-09-10T23:24:28.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57577 6.00 MB/sec execute 386 sec latency 454.341 ms 2024-09-10T23:24:28.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:28 smithi046 ceph-mon[28128]: pgmap v921: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-10T23:24:28.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:28 smithi073 ceph-mon[35473]: pgmap v921: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-10T23:24:28.866 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280804 28.85 MB/sec execute 384 sec latency 803.625 ms 2024-09-10T23:24:29.444 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57654 5.99 MB/sec execute 387 sec latency 270.432 ms 2024-09-10T23:24:29.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280819 28.78 MB/sec execute 385 sec latency 948.935 ms 2024-09-10T23:24:30.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57740 5.98 MB/sec execute 388 sec latency 445.453 ms 2024-09-10T23:24:30.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:30 smithi046 ceph-mon[28128]: pgmap v922: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 96 op/s 2024-09-10T23:24:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:30 smithi073 ceph-mon[35473]: pgmap v922: 129 pgs: 129 active+clean; 462 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 96 op/s 2024-09-10T23:24:30.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280912 28.72 MB/sec execute 386 sec latency 1355.755 ms 2024-09-10T23:24:31.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57796 5.97 MB/sec execute 389 sec latency 381.005 ms 2024-09-10T23:24:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:31.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:31.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280915 28.64 MB/sec execute 387 sec latency 1345.685 ms 2024-09-10T23:24:32.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57872 5.96 MB/sec execute 390 sec latency 446.476 ms 2024-09-10T23:24:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:32 smithi046 ceph-mon[28128]: pgmap v923: 129 pgs: 129 active+clean; 462 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.8 KiB/s rd, 3.2 MiB/s wr, 130 op/s 2024-09-10T23:24:32.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:32 smithi073 ceph-mon[35473]: pgmap v923: 129 pgs: 129 active+clean; 462 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.8 KiB/s rd, 3.2 MiB/s wr, 130 op/s 2024-09-10T23:24:32.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280915 28.57 MB/sec execute 388 sec latency 1121.970 ms 2024-09-10T23:24:33.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57921 5.95 MB/sec execute 391 sec latency 458.030 ms 2024-09-10T23:24:33.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281018 28.51 MB/sec execute 389 sec latency 1407.184 ms 2024-09-10T23:24:34.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 57980 5.94 MB/sec execute 392 sec latency 509.563 ms 2024-09-10T23:24:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:34 smithi046 ceph-mon[28128]: pgmap v924: 129 pgs: 129 active+clean; 461 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.0 MiB/s wr, 91 op/s 2024-09-10T23:24:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:34 smithi073 ceph-mon[35473]: pgmap v924: 129 pgs: 129 active+clean; 461 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.0 MiB/s wr, 91 op/s 2024-09-10T23:24:34.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281026 28.44 MB/sec execute 390 sec latency 1401.390 ms 2024-09-10T23:24:35.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58103 5.94 MB/sec execute 393 sec latency 278.142 ms 2024-09-10T23:24:35.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281037 28.36 MB/sec execute 391 sec latency 1267.809 ms 2024-09-10T23:24:36.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58167 5.94 MB/sec execute 394 sec latency 416.467 ms 2024-09-10T23:24:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:36 smithi046 ceph-mon[28128]: pgmap v925: 129 pgs: 129 active+clean; 448 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.1 MiB/s wr, 107 op/s 2024-09-10T23:24:36.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:36 smithi073 ceph-mon[35473]: pgmap v925: 129 pgs: 129 active+clean; 448 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.1 MiB/s wr, 107 op/s 2024-09-10T23:24:36.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281051 28.29 MB/sec execute 392 sec latency 1458.900 ms 2024-09-10T23:24:37.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58251 5.93 MB/sec execute 395 sec latency 523.871 ms 2024-09-10T23:24:37.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281088 28.22 MB/sec execute 393 sec latency 1388.415 ms 2024-09-10T23:24:38.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58409 5.95 MB/sec execute 396 sec latency 89.108 ms 2024-09-10T23:24:38.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:38 smithi046 ceph-mon[28128]: pgmap v926: 129 pgs: 129 active+clean; 425 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 1.9 MiB/s wr, 118 op/s 2024-09-10T23:24:38.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:38 smithi073 ceph-mon[35473]: pgmap v926: 129 pgs: 129 active+clean; 425 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 1.9 MiB/s wr, 118 op/s 2024-09-10T23:24:38.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281478 28.21 MB/sec execute 394 sec latency 474.462 ms 2024-09-10T23:24:39.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58521 5.95 MB/sec execute 397 sec latency 208.590 ms 2024-09-10T23:24:39.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 281979 28.19 MB/sec execute 395 sec latency 482.710 ms 2024-09-10T23:24:40.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58649 5.95 MB/sec execute 398 sec latency 146.606 ms 2024-09-10T23:24:40.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:40 smithi073 ceph-mon[35473]: pgmap v927: 129 pgs: 129 active+clean; 425 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 1.5 MiB/s wr, 110 op/s 2024-09-10T23:24:40.867 INFO:tasks.workunit.client.0.smithi046.stdout: 10 282288 28.15 MB/sec execute 396 sec latency 749.742 ms 2024-09-10T23:24:40.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:40 smithi046 ceph-mon[28128]: pgmap v927: 129 pgs: 129 active+clean; 425 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 1.5 MiB/s wr, 110 op/s 2024-09-10T23:24:41.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58745 5.94 MB/sec execute 399 sec latency 285.004 ms 2024-09-10T23:24:41.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 282873 28.18 MB/sec execute 397 sec latency 491.760 ms 2024-09-10T23:24:42.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 58899 5.94 MB/sec execute 400 sec latency 85.301 ms 2024-09-10T23:24:42.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:42 smithi073 ceph-mon[35473]: pgmap v928: 129 pgs: 129 active+clean; 425 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-10T23:24:42.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 283967 28.26 MB/sec execute 398 sec latency 185.198 ms 2024-09-10T23:24:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:42 smithi046 ceph-mon[28128]: pgmap v928: 129 pgs: 129 active+clean; 425 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-10T23:24:43.445 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59023 5.93 MB/sec execute 401 sec latency 217.336 ms 2024-09-10T23:24:43.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 284222 28.23 MB/sec execute 399 sec latency 830.904 ms 2024-09-10T23:24:44.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59168 5.93 MB/sec execute 402 sec latency 120.182 ms 2024-09-10T23:24:44.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 284349 28.18 MB/sec execute 400 sec latency 515.761 ms 2024-09-10T23:24:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:44 smithi046 ceph-mon[28128]: pgmap v929: 129 pgs: 129 active+clean; 427 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-09-10T23:24:45.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:44 smithi073 ceph-mon[35473]: pgmap v929: 129 pgs: 129 active+clean; 427 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-09-10T23:24:45.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59305 5.93 MB/sec execute 403 sec latency 236.306 ms 2024-09-10T23:24:45.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 284593 28.13 MB/sec execute 401 sec latency 521.121 ms 2024-09-10T23:24:46.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59416 5.93 MB/sec execute 404 sec latency 156.844 ms 2024-09-10T23:24:46.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 284866 28.10 MB/sec execute 402 sec latency 491.306 ms 2024-09-10T23:24:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:46 smithi046 ceph-mon[28128]: pgmap v930: 129 pgs: 129 active+clean; 429 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-09-10T23:24:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:46 smithi073 ceph-mon[35473]: pgmap v930: 129 pgs: 129 active+clean; 429 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-09-10T23:24:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:24:47.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59534 5.93 MB/sec execute 405 sec latency 157.907 ms 2024-09-10T23:24:47.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 285132 28.06 MB/sec execute 403 sec latency 466.326 ms 2024-09-10T23:24:48.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59669 5.95 MB/sec execute 406 sec latency 110.995 ms 2024-09-10T23:24:48.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 285664 28.04 MB/sec execute 404 sec latency 583.370 ms 2024-09-10T23:24:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:48 smithi046 ceph-mon[28128]: pgmap v931: 129 pgs: 129 active+clean; 431 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.2 MiB/s wr, 135 op/s 2024-09-10T23:24:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:48 smithi073 ceph-mon[35473]: pgmap v931: 129 pgs: 129 active+clean; 431 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.2 MiB/s wr, 135 op/s 2024-09-10T23:24:49.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59848 5.97 MB/sec execute 407 sec latency 203.416 ms 2024-09-10T23:24:49.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 286032 28.03 MB/sec execute 405 sec latency 728.685 ms 2024-09-10T23:24:50.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 59993 5.99 MB/sec execute 408 sec latency 351.503 ms 2024-09-10T23:24:50.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 286869 28.09 MB/sec execute 406 sec latency 159.172 ms 2024-09-10T23:24:50.988 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:50 smithi073 ceph-mon[35473]: pgmap v932: 129 pgs: 129 active+clean; 435 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-09-10T23:24:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:50 smithi046 ceph-mon[28128]: pgmap v932: 129 pgs: 129 active+clean; 435 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-09-10T23:24:51.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60179 6.01 MB/sec execute 409 sec latency 114.760 ms 2024-09-10T23:24:51.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 287471 28.10 MB/sec execute 407 sec latency 679.983 ms 2024-09-10T23:24:52.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60270 6.00 MB/sec execute 410 sec latency 234.355 ms 2024-09-10T23:24:52.868 INFO:tasks.workunit.client.0.smithi046.stdout: 10 287771 28.08 MB/sec execute 408 sec latency 535.469 ms 2024-09-10T23:24:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:52 smithi046 ceph-mon[28128]: pgmap v933: 129 pgs: 129 active+clean; 444 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.3 MiB/s wr, 136 op/s 2024-09-10T23:24:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:52 smithi073 ceph-mon[35473]: pgmap v933: 129 pgs: 129 active+clean; 444 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.3 MiB/s wr, 136 op/s 2024-09-10T23:24:53.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60344 6.00 MB/sec execute 411 sec latency 174.818 ms 2024-09-10T23:24:53.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 288149 28.05 MB/sec execute 409 sec latency 424.836 ms 2024-09-10T23:24:54.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60458 6.01 MB/sec execute 412 sec latency 90.140 ms 2024-09-10T23:24:54.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 288305 28.00 MB/sec execute 410 sec latency 693.513 ms 2024-09-10T23:24:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:54 smithi046 ceph-mon[28128]: pgmap v934: 129 pgs: 129 active+clean; 445 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.0 MiB/s wr, 118 op/s 2024-09-10T23:24:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:54 smithi073 ceph-mon[35473]: pgmap v934: 129 pgs: 129 active+clean; 445 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.0 MiB/s wr, 118 op/s 2024-09-10T23:24:55.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60583 6.02 MB/sec execute 413 sec latency 182.783 ms 2024-09-10T23:24:55.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 289344 28.05 MB/sec execute 411 sec latency 135.729 ms 2024-09-10T23:24:56.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60730 6.03 MB/sec execute 414 sec latency 106.981 ms 2024-09-10T23:24:56.616 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:56 smithi046 ceph-mon[28128]: pgmap v935: 129 pgs: 129 active+clean; 449 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.1 KiB/s rd, 3.6 MiB/s wr, 119 op/s 2024-09-10T23:24:56.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 290658 28.17 MB/sec execute 412 sec latency 135.036 ms 2024-09-10T23:24:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:56 smithi073 ceph-mon[35473]: pgmap v935: 129 pgs: 129 active+clean; 449 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.1 KiB/s rd, 3.6 MiB/s wr, 119 op/s 2024-09-10T23:24:57.446 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60840 6.03 MB/sec execute 415 sec latency 121.159 ms 2024-09-10T23:24:57.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 291406 28.21 MB/sec execute 413 sec latency 126.995 ms 2024-09-10T23:24:58.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 60947 6.02 MB/sec execute 416 sec latency 77.387 ms 2024-09-10T23:24:58.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 291787 28.19 MB/sec execute 414 sec latency 117.491 ms 2024-09-10T23:24:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:24:58 smithi046 ceph-mon[28128]: pgmap v936: 129 pgs: 129 active+clean; 453 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 4.0 MiB/s wr, 122 op/s 2024-09-10T23:24:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:24:58 smithi073 ceph-mon[35473]: pgmap v936: 129 pgs: 129 active+clean; 453 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 4.0 MiB/s wr, 122 op/s 2024-09-10T23:24:59.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61038 6.01 MB/sec execute 417 sec latency 110.716 ms 2024-09-10T23:24:59.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 292493 28.20 MB/sec execute 415 sec latency 375.444 ms 2024-09-10T23:25:00.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61150 6.00 MB/sec execute 418 sec latency 122.491 ms 2024-09-10T23:25:00.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 293602 28.29 MB/sec execute 416 sec latency 537.942 ms 2024-09-10T23:25:00.993 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:00 smithi073 ceph-mon[35473]: pgmap v937: 129 pgs: 129 active+clean; 453 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.7 MiB/s wr, 107 op/s 2024-09-10T23:25:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:00 smithi046 ceph-mon[28128]: pgmap v937: 129 pgs: 129 active+clean; 453 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.7 MiB/s wr, 107 op/s 2024-09-10T23:25:01.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61271 5.99 MB/sec execute 419 sec latency 113.752 ms 2024-09-10T23:25:01.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:01.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:01.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 294615 28.35 MB/sec execute 417 sec latency 251.814 ms 2024-09-10T23:25:02.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:02.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:02.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61371 5.99 MB/sec execute 420 sec latency 185.489 ms 2024-09-10T23:25:02.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 294915 28.33 MB/sec execute 418 sec latency 839.828 ms 2024-09-10T23:25:03.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:02 smithi046 ceph-mon[28128]: pgmap v938: 129 pgs: 129 active+clean; 456 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 128 op/s 2024-09-10T23:25:03.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:25:03.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:25:03.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:25:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:02 smithi073 ceph-mon[35473]: pgmap v938: 129 pgs: 129 active+clean; 456 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 128 op/s 2024-09-10T23:25:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:25:03.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:25:03.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:25:03.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61486 5.98 MB/sec execute 421 sec latency 118.500 ms 2024-09-10T23:25:03.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 295269 28.30 MB/sec execute 419 sec latency 119.592 ms 2024-09-10T23:25:04.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61644 5.99 MB/sec execute 422 sec latency 114.497 ms 2024-09-10T23:25:04.869 INFO:tasks.workunit.client.0.smithi046.stdout: 10 296203 28.33 MB/sec execute 420 sec latency 127.694 ms 2024-09-10T23:25:05.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:04 smithi046 ceph-mon[28128]: pgmap v939: 129 pgs: 129 active+clean; 457 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.1 MiB/s wr, 106 op/s 2024-09-10T23:25:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:04 smithi073 ceph-mon[35473]: pgmap v939: 129 pgs: 129 active+clean; 457 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.1 MiB/s wr, 106 op/s 2024-09-10T23:25:05.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61793 5.99 MB/sec execute 423 sec latency 100.107 ms 2024-09-10T23:25:05.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 297303 28.43 MB/sec execute 421 sec latency 134.049 ms 2024-09-10T23:25:06.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 61947 6.01 MB/sec execute 424 sec latency 89.510 ms 2024-09-10T23:25:06.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 298373 28.50 MB/sec execute 422 sec latency 201.411 ms 2024-09-10T23:25:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:06 smithi046 ceph-mon[28128]: pgmap v940: 129 pgs: 129 active+clean; 447 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 138 op/s 2024-09-10T23:25:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:06 smithi073 ceph-mon[35473]: pgmap v940: 129 pgs: 129 active+clean; 447 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 138 op/s 2024-09-10T23:25:07.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62080 6.01 MB/sec execute 425 sec latency 118.404 ms 2024-09-10T23:25:07.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 298493 28.45 MB/sec execute 423 sec latency 493.667 ms 2024-09-10T23:25:08.447 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62211 6.01 MB/sec execute 426 sec latency 109.667 ms 2024-09-10T23:25:08.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 298910 28.43 MB/sec execute 424 sec latency 127.181 ms 2024-09-10T23:25:09.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:08 smithi046 ceph-mon[28128]: pgmap v941: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 160 op/s 2024-09-10T23:25:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:08 smithi073 ceph-mon[35473]: pgmap v941: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 160 op/s 2024-09-10T23:25:09.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62303 6.01 MB/sec execute 427 sec latency 444.184 ms 2024-09-10T23:25:09.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 299946 28.47 MB/sec execute 425 sec latency 127.259 ms 2024-09-10T23:25:10.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62451 6.00 MB/sec execute 428 sec latency 86.165 ms 2024-09-10T23:25:10.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 301236 28.60 MB/sec execute 426 sec latency 123.484 ms 2024-09-10T23:25:10.989 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:10 smithi073 ceph-mon[35473]: pgmap v942: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 139 op/s 2024-09-10T23:25:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:10 smithi046 ceph-mon[28128]: pgmap v942: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 139 op/s 2024-09-10T23:25:11.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62610 6.00 MB/sec execute 429 sec latency 69.645 ms 2024-09-10T23:25:11.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302034 28.63 MB/sec execute 427 sec latency 141.803 ms 2024-09-10T23:25:12.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62752 5.99 MB/sec execute 430 sec latency 90.795 ms 2024-09-10T23:25:12.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302305 28.59 MB/sec execute 428 sec latency 552.944 ms 2024-09-10T23:25:13.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:12 smithi046 ceph-mon[28128]: pgmap v943: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.1 MiB/s wr, 191 op/s 2024-09-10T23:25:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:12 smithi073 ceph-mon[35473]: pgmap v943: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.1 MiB/s wr, 191 op/s 2024-09-10T23:25:13.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62813 5.99 MB/sec execute 431 sec latency 349.551 ms 2024-09-10T23:25:13.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302312 28.53 MB/sec execute 429 sec latency 912.553 ms 2024-09-10T23:25:14.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62903 5.98 MB/sec execute 432 sec latency 453.605 ms 2024-09-10T23:25:14.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302318 28.46 MB/sec execute 430 sec latency 1317.629 ms 2024-09-10T23:25:15.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:14 smithi046 ceph-mon[28128]: pgmap v944: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-09-10T23:25:15.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:14 smithi073 ceph-mon[35473]: pgmap v944: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-09-10T23:25:15.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 62948 5.97 MB/sec execute 433 sec latency 406.041 ms 2024-09-10T23:25:15.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302335 28.39 MB/sec execute 431 sec latency 1308.351 ms 2024-09-10T23:25:16.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63011 5.97 MB/sec execute 434 sec latency 390.955 ms 2024-09-10T23:25:16.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302353 28.33 MB/sec execute 432 sec latency 1096.453 ms 2024-09-10T23:25:17.217 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:16 smithi046 ceph-mon[28128]: pgmap v945: 129 pgs: 129 active+clean; 448 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 172 op/s 2024-09-10T23:25:17.218 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:16 smithi073 ceph-mon[35473]: pgmap v945: 129 pgs: 129 active+clean; 448 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 172 op/s 2024-09-10T23:25:17.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:17.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63067 5.96 MB/sec execute 435 sec latency 429.053 ms 2024-09-10T23:25:17.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302364 28.26 MB/sec execute 433 sec latency 1104.046 ms 2024-09-10T23:25:18.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63123 5.95 MB/sec execute 436 sec latency 369.737 ms 2024-09-10T23:25:18.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302384 28.20 MB/sec execute 434 sec latency 1324.478 ms 2024-09-10T23:25:19.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:18 smithi046 ceph-mon[28128]: pgmap v946: 129 pgs: 129 active+clean; 448 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.3 MiB/s wr, 152 op/s 2024-09-10T23:25:19.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:18 smithi073 ceph-mon[35473]: pgmap v946: 129 pgs: 129 active+clean; 448 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.3 MiB/s wr, 152 op/s 2024-09-10T23:25:19.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63214 5.96 MB/sec execute 437 sec latency 400.316 ms 2024-09-10T23:25:19.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302447 28.15 MB/sec execute 435 sec latency 1280.798 ms 2024-09-10T23:25:20.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63308 5.97 MB/sec execute 438 sec latency 408.531 ms 2024-09-10T23:25:20.870 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302465 28.08 MB/sec execute 436 sec latency 1245.475 ms 2024-09-10T23:25:21.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:20 smithi046 ceph-mon[28128]: pgmap v947: 129 pgs: 129 active+clean; 449 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.9 MiB/s wr, 109 op/s 2024-09-10T23:25:21.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:20 smithi073 ceph-mon[35473]: pgmap v947: 129 pgs: 129 active+clean; 449 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.9 MiB/s wr, 109 op/s 2024-09-10T23:25:21.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63442 5.98 MB/sec execute 439 sec latency 371.000 ms 2024-09-10T23:25:21.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302499 28.02 MB/sec execute 437 sec latency 1277.046 ms 2024-09-10T23:25:22.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63519 5.98 MB/sec execute 440 sec latency 514.861 ms 2024-09-10T23:25:22.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 302604 27.97 MB/sec execute 438 sec latency 1285.755 ms 2024-09-10T23:25:23.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:22 smithi046 ceph-mon[28128]: pgmap v948: 129 pgs: 129 active+clean; 455 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2024-09-10T23:25:23.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:22 smithi073 ceph-mon[35473]: pgmap v948: 129 pgs: 129 active+clean; 455 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2024-09-10T23:25:23.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63712 6.00 MB/sec execute 441 sec latency 413.241 ms 2024-09-10T23:25:23.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 303199 27.97 MB/sec execute 439 sec latency 1089.239 ms 2024-09-10T23:25:24.448 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63825 6.00 MB/sec execute 442 sec latency 67.454 ms 2024-09-10T23:25:24.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 304375 28.07 MB/sec execute 440 sec latency 118.347 ms 2024-09-10T23:25:25.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:24 smithi046 ceph-mon[28128]: pgmap v949: 129 pgs: 129 active+clean; 452 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.8 KiB/s rd, 2.1 MiB/s wr, 78 op/s 2024-09-10T23:25:25.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:24 smithi073 ceph-mon[35473]: pgmap v949: 129 pgs: 129 active+clean; 452 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.8 KiB/s rd, 2.1 MiB/s wr, 78 op/s 2024-09-10T23:25:25.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 63901 6.00 MB/sec execute 443 sec latency 91.933 ms 2024-09-10T23:25:25.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 305485 28.14 MB/sec execute 441 sec latency 145.273 ms 2024-09-10T23:25:26.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64015 6.01 MB/sec execute 444 sec latency 81.085 ms 2024-09-10T23:25:26.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 305861 28.12 MB/sec execute 442 sec latency 104.273 ms 2024-09-10T23:25:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:26 smithi046 ceph-mon[28128]: pgmap v950: 129 pgs: 129 active+clean; 450 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-10T23:25:27.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:26 smithi073 ceph-mon[35473]: pgmap v950: 129 pgs: 129 active+clean; 450 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-10T23:25:27.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64156 6.02 MB/sec execute 445 sec latency 81.576 ms 2024-09-10T23:25:27.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 306355 28.11 MB/sec execute 443 sec latency 258.385 ms 2024-09-10T23:25:28.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64255 6.03 MB/sec execute 446 sec latency 451.990 ms 2024-09-10T23:25:28.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 306423 28.06 MB/sec execute 444 sec latency 982.636 ms 2024-09-10T23:25:29.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:28 smithi046 ceph-mon[28128]: pgmap v951: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.8 MiB/s wr, 87 op/s 2024-09-10T23:25:29.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:28 smithi073 ceph-mon[35473]: pgmap v951: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.8 MiB/s wr, 87 op/s 2024-09-10T23:25:29.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64331 6.02 MB/sec execute 447 sec latency 348.406 ms 2024-09-10T23:25:29.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 306628 28.01 MB/sec execute 445 sec latency 1367.737 ms 2024-09-10T23:25:30.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64411 6.01 MB/sec execute 448 sec latency 378.194 ms 2024-09-10T23:25:30.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 306664 27.95 MB/sec execute 446 sec latency 1150.746 ms 2024-09-10T23:25:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:30 smithi046 ceph-mon[28128]: pgmap v952: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.7 MiB/s wr, 75 op/s 2024-09-10T23:25:31.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:30 smithi073 ceph-mon[35473]: pgmap v952: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.7 MiB/s wr, 75 op/s 2024-09-10T23:25:31.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64476 6.00 MB/sec execute 449 sec latency 373.265 ms 2024-09-10T23:25:31.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 307401 27.98 MB/sec execute 447 sec latency 1311.015 ms 2024-09-10T23:25:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:32.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64576 5.99 MB/sec execute 450 sec latency 110.574 ms 2024-09-10T23:25:32.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 308602 28.07 MB/sec execute 448 sec latency 142.359 ms 2024-09-10T23:25:33.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:32 smithi046 ceph-mon[28128]: pgmap v953: 129 pgs: 129 active+clean; 445 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.7 MiB/s wr, 113 op/s 2024-09-10T23:25:33.330 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:32 smithi073 ceph-mon[35473]: pgmap v953: 129 pgs: 129 active+clean; 445 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.7 MiB/s wr, 113 op/s 2024-09-10T23:25:33.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64685 5.98 MB/sec execute 451 sec latency 110.733 ms 2024-09-10T23:25:33.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 309123 28.08 MB/sec execute 449 sec latency 284.724 ms 2024-09-10T23:25:34.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64792 5.98 MB/sec execute 452 sec latency 154.479 ms 2024-09-10T23:25:34.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 309466 28.05 MB/sec execute 450 sec latency 143.663 ms 2024-09-10T23:25:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:34 smithi046 ceph-mon[28128]: pgmap v954: 129 pgs: 129 active+clean; 446 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-10T23:25:35.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:34 smithi073 ceph-mon[35473]: pgmap v954: 129 pgs: 129 active+clean; 446 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-10T23:25:35.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 64931 5.97 MB/sec execute 453 sec latency 196.394 ms 2024-09-10T23:25:35.871 INFO:tasks.workunit.client.0.smithi046.stdout: 10 310532 28.09 MB/sec execute 451 sec latency 116.399 ms 2024-09-10T23:25:36.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65065 5.98 MB/sec execute 454 sec latency 121.227 ms 2024-09-10T23:25:36.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 311065 28.11 MB/sec execute 452 sec latency 526.826 ms 2024-09-10T23:25:37.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:36 smithi046 ceph-mon[28128]: pgmap v955: 129 pgs: 129 active+clean; 445 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 96 op/s 2024-09-10T23:25:37.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:36 smithi073 ceph-mon[35473]: pgmap v955: 129 pgs: 129 active+clean; 445 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 96 op/s 2024-09-10T23:25:37.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65117 5.97 MB/sec execute 455 sec latency 524.844 ms 2024-09-10T23:25:37.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 311191 28.07 MB/sec execute 453 sec latency 1290.385 ms 2024-09-10T23:25:38.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65185 5.96 MB/sec execute 456 sec latency 456.569 ms 2024-09-10T23:25:38.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 311347 28.03 MB/sec execute 454 sec latency 1335.820 ms 2024-09-10T23:25:39.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:38 smithi046 ceph-mon[28128]: pgmap v956: 129 pgs: 129 active+clean; 447 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 127 op/s 2024-09-10T23:25:39.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:38 smithi073 ceph-mon[35473]: pgmap v956: 129 pgs: 129 active+clean; 447 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 127 op/s 2024-09-10T23:25:39.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65290 5.96 MB/sec execute 457 sec latency 394.053 ms 2024-09-10T23:25:39.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 312147 28.06 MB/sec execute 455 sec latency 1324.144 ms 2024-09-10T23:25:40.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65418 5.97 MB/sec execute 458 sec latency 290.079 ms 2024-09-10T23:25:40.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 312827 28.08 MB/sec execute 456 sec latency 109.078 ms 2024-09-10T23:25:41.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:40 smithi046 ceph-mon[28128]: pgmap v957: 129 pgs: 129 active+clean; 445 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2024-09-10T23:25:41.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:40 smithi073 ceph-mon[35473]: pgmap v957: 129 pgs: 129 active+clean; 445 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2024-09-10T23:25:41.449 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65561 5.98 MB/sec execute 459 sec latency 90.637 ms 2024-09-10T23:25:41.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 313451 28.09 MB/sec execute 457 sec latency 97.435 ms 2024-09-10T23:25:42.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65705 5.98 MB/sec execute 460 sec latency 81.445 ms 2024-09-10T23:25:42.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 314583 28.15 MB/sec execute 458 sec latency 120.924 ms 2024-09-10T23:25:43.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:42 smithi046 ceph-mon[28128]: pgmap v958: 129 pgs: 129 active+clean; 434 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.9 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2024-09-10T23:25:43.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:42 smithi073 ceph-mon[35473]: pgmap v958: 129 pgs: 129 active+clean; 434 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.9 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2024-09-10T23:25:43.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65852 5.98 MB/sec execute 461 sec latency 80.723 ms 2024-09-10T23:25:43.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 315695 28.23 MB/sec execute 459 sec latency 184.822 ms 2024-09-10T23:25:44.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 65951 5.97 MB/sec execute 462 sec latency 347.323 ms 2024-09-10T23:25:44.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 316031 28.21 MB/sec execute 460 sec latency 733.020 ms 2024-09-10T23:25:45.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:44 smithi046 ceph-mon[28128]: pgmap v959: 129 pgs: 129 active+clean; 432 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 2.1 MiB/s wr, 120 op/s 2024-09-10T23:25:45.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:44 smithi073 ceph-mon[35473]: pgmap v959: 129 pgs: 129 active+clean; 432 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 2.1 MiB/s wr, 120 op/s 2024-09-10T23:25:45.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66042 5.96 MB/sec execute 463 sec latency 464.846 ms 2024-09-10T23:25:45.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 316064 28.15 MB/sec execute 461 sec latency 1428.798 ms 2024-09-10T23:25:46.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66115 5.95 MB/sec execute 464 sec latency 445.571 ms 2024-09-10T23:25:46.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 316215 28.11 MB/sec execute 462 sec latency 1561.317 ms 2024-09-10T23:25:47.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:46 smithi046 ceph-mon[28128]: pgmap v960: 129 pgs: 129 active+clean; 435 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.4 MiB/s wr, 160 op/s 2024-09-10T23:25:47.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:46 smithi073 ceph-mon[35473]: pgmap v960: 129 pgs: 129 active+clean; 435 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.4 MiB/s wr, 160 op/s 2024-09-10T23:25:47.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:25:47.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66260 5.95 MB/sec execute 465 sec latency 95.896 ms 2024-09-10T23:25:47.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 316574 28.09 MB/sec execute 463 sec latency 124.666 ms 2024-09-10T23:25:48.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66413 5.95 MB/sec execute 466 sec latency 80.733 ms 2024-09-10T23:25:48.872 INFO:tasks.workunit.client.0.smithi046.stdout: 10 317668 28.13 MB/sec execute 464 sec latency 166.083 ms 2024-09-10T23:25:49.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:48 smithi046 ceph-mon[28128]: pgmap v961: 129 pgs: 129 active+clean; 435 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.6 KiB/s rd, 2.3 MiB/s wr, 164 op/s 2024-09-10T23:25:49.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:48 smithi073 ceph-mon[35473]: pgmap v961: 129 pgs: 129 active+clean; 435 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.6 KiB/s rd, 2.3 MiB/s wr, 164 op/s 2024-09-10T23:25:49.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66517 5.95 MB/sec execute 467 sec latency 115.513 ms 2024-09-10T23:25:49.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 318747 28.22 MB/sec execute 465 sec latency 163.855 ms 2024-09-10T23:25:50.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66654 5.95 MB/sec execute 468 sec latency 78.422 ms 2024-09-10T23:25:50.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 319724 28.28 MB/sec execute 466 sec latency 131.312 ms 2024-09-10T23:25:51.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:50 smithi046 ceph-mon[28128]: pgmap v962: 129 pgs: 129 active+clean; 436 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 MiB/s wr, 126 op/s 2024-09-10T23:25:51.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:50 smithi073 ceph-mon[35473]: pgmap v962: 129 pgs: 129 active+clean; 436 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.6 KiB/s rd, 1.8 MiB/s wr, 126 op/s 2024-09-10T23:25:51.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 66807 5.97 MB/sec execute 469 sec latency 80.628 ms 2024-09-10T23:25:51.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 320099 28.25 MB/sec execute 467 sec latency 136.094 ms 2024-09-10T23:25:52.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67038 6.00 MB/sec execute 470 sec latency 80.175 ms 2024-09-10T23:25:52.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 321130 28.29 MB/sec execute 468 sec latency 122.479 ms 2024-09-10T23:25:53.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:52 smithi046 ceph-mon[28128]: pgmap v963: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.7 MiB/s wr, 158 op/s 2024-09-10T23:25:53.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:52 smithi073 ceph-mon[35473]: pgmap v963: 129 pgs: 129 active+clean; 442 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.7 MiB/s wr, 158 op/s 2024-09-10T23:25:53.450 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67244 6.02 MB/sec execute 471 sec latency 97.158 ms 2024-09-10T23:25:53.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 321811 28.33 MB/sec execute 469 sec latency 345.050 ms 2024-09-10T23:25:54.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67360 6.02 MB/sec execute 472 sec latency 80.469 ms 2024-09-10T23:25:54.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 322915 28.40 MB/sec execute 470 sec latency 218.696 ms 2024-09-10T23:25:55.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:55 smithi046 ceph-mon[28128]: pgmap v964: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 MiB/s wr, 108 op/s 2024-09-10T23:25:55.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:55 smithi073 ceph-mon[35473]: pgmap v964: 129 pgs: 129 active+clean; 443 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 MiB/s wr, 108 op/s 2024-09-10T23:25:55.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67437 6.03 MB/sec execute 473 sec latency 84.429 ms 2024-09-10T23:25:55.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 323464 28.40 MB/sec execute 471 sec latency 159.823 ms 2024-09-10T23:25:56.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67533 6.03 MB/sec execute 474 sec latency 95.286 ms 2024-09-10T23:25:56.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 324016 28.41 MB/sec execute 472 sec latency 125.923 ms 2024-09-10T23:25:57.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:57 smithi046 ceph-mon[28128]: pgmap v965: 129 pgs: 129 active+clean; 452 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 3.3 MiB/s wr, 143 op/s 2024-09-10T23:25:57.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:57 smithi073 ceph-mon[35473]: pgmap v965: 129 pgs: 129 active+clean; 452 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 3.3 MiB/s wr, 143 op/s 2024-09-10T23:25:57.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67676 6.04 MB/sec execute 475 sec latency 86.597 ms 2024-09-10T23:25:57.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 325045 28.45 MB/sec execute 473 sec latency 135.165 ms 2024-09-10T23:25:58.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67823 6.05 MB/sec execute 476 sec latency 102.335 ms 2024-09-10T23:25:58.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 325792 28.49 MB/sec execute 474 sec latency 442.587 ms 2024-09-10T23:25:59.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:25:59 smithi046 ceph-mon[28128]: pgmap v966: 129 pgs: 129 active+clean; 457 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.5 MiB/s wr, 113 op/s 2024-09-10T23:25:59.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:25:59 smithi073 ceph-mon[35473]: pgmap v966: 129 pgs: 129 active+clean; 457 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.5 MiB/s wr, 113 op/s 2024-09-10T23:25:59.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 67946 6.05 MB/sec execute 477 sec latency 99.054 ms 2024-09-10T23:25:59.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 326728 28.54 MB/sec execute 475 sec latency 273.304 ms 2024-09-10T23:26:00.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68043 6.04 MB/sec execute 478 sec latency 102.945 ms 2024-09-10T23:26:00.873 INFO:tasks.workunit.client.0.smithi046.stdout: 10 327126 28.52 MB/sec execute 476 sec latency 116.983 ms 2024-09-10T23:26:01.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:01 smithi046 ceph-mon[28128]: pgmap v967: 129 pgs: 129 active+clean; 458 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.7 MiB/s wr, 118 op/s 2024-09-10T23:26:01.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:01 smithi073 ceph-mon[35473]: pgmap v967: 129 pgs: 129 active+clean; 458 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.5 KiB/s rd, 3.7 MiB/s wr, 118 op/s 2024-09-10T23:26:01.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68150 6.03 MB/sec execute 479 sec latency 83.918 ms 2024-09-10T23:26:01.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 327319 28.48 MB/sec execute 477 sec latency 433.359 ms 2024-09-10T23:26:02.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:02 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:02.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:02 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:02.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68201 6.02 MB/sec execute 480 sec latency 552.318 ms 2024-09-10T23:26:02.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 328221 28.50 MB/sec execute 478 sec latency 834.305 ms 2024-09-10T23:26:03.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:03 smithi046 ceph-mon[28128]: pgmap v968: 129 pgs: 129 active+clean; 461 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.8 MiB/s wr, 151 op/s 2024-09-10T23:26:03.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:03 smithi073 ceph-mon[35473]: pgmap v968: 129 pgs: 129 active+clean; 461 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.8 MiB/s wr, 151 op/s 2024-09-10T23:26:03.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68317 6.02 MB/sec execute 481 sec latency 164.926 ms 2024-09-10T23:26:03.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 329074 28.56 MB/sec execute 479 sec latency 220.079 ms 2024-09-10T23:26:04.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:04 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:26:04.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:04 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:26:04.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68418 6.01 MB/sec execute 482 sec latency 155.020 ms 2024-09-10T23:26:04.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 329139 28.51 MB/sec execute 480 sec latency 1038.838 ms 2024-09-10T23:26:05.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:05 smithi046 ceph-mon[28128]: pgmap v969: 129 pgs: 129 active+clean; 462 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.8 MiB/s wr, 113 op/s 2024-09-10T23:26:05.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:05 smithi073 ceph-mon[35473]: pgmap v969: 129 pgs: 129 active+clean; 462 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.8 MiB/s wr, 113 op/s 2024-09-10T23:26:05.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68483 6.00 MB/sec execute 483 sec latency 357.508 ms 2024-09-10T23:26:05.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 330119 28.56 MB/sec execute 481 sec latency 1310.593 ms 2024-09-10T23:26:06.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68614 6.00 MB/sec execute 484 sec latency 139.354 ms 2024-09-10T23:26:06.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:06 smithi046 ceph-mon[28128]: pgmap v970: 129 pgs: 129 active+clean; 461 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 127 op/s 2024-09-10T23:26:06.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:06 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:06 smithi073 ceph-mon[35473]: pgmap v970: 129 pgs: 129 active+clean; 461 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 127 op/s 2024-09-10T23:26:06.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:06 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:06.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 330406 28.53 MB/sec execute 482 sec latency 452.054 ms 2024-09-10T23:26:07.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68740 6.00 MB/sec execute 485 sec latency 264.692 ms 2024-09-10T23:26:07.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 330427 28.48 MB/sec execute 483 sec latency 1033.073 ms 2024-09-10T23:26:08.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68858 6.00 MB/sec execute 486 sec latency 283.091 ms 2024-09-10T23:26:08.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:08 smithi046 ceph-mon[28128]: pgmap v971: 129 pgs: 129 active+clean; 459 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.2 MiB/s wr, 124 op/s 2024-09-10T23:26:08.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:08 smithi073 ceph-mon[35473]: pgmap v971: 129 pgs: 129 active+clean; 459 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.2 MiB/s wr, 124 op/s 2024-09-10T23:26:08.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 330552 28.43 MB/sec execute 484 sec latency 1212.511 ms 2024-09-10T23:26:09.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 68980 6.01 MB/sec execute 487 sec latency 328.713 ms 2024-09-10T23:26:09.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 330710 28.39 MB/sec execute 485 sec latency 1161.120 ms 2024-09-10T23:26:10.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69109 6.01 MB/sec execute 488 sec latency 165.156 ms 2024-09-10T23:26:10.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:10 smithi046 ceph-mon[28128]: pgmap v972: 129 pgs: 129 active+clean; 455 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2024-09-10T23:26:10.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:10 smithi073 ceph-mon[35473]: pgmap v972: 129 pgs: 129 active+clean; 455 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2024-09-10T23:26:10.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 330741 28.33 MB/sec execute 486 sec latency 867.503 ms 2024-09-10T23:26:11.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69223 6.02 MB/sec execute 489 sec latency 327.019 ms 2024-09-10T23:26:11.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 331107 28.32 MB/sec execute 487 sec latency 1082.187 ms 2024-09-10T23:26:12.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69319 6.01 MB/sec execute 490 sec latency 267.165 ms 2024-09-10T23:26:12.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:12 smithi046 ceph-mon[28128]: pgmap v973: 129 pgs: 129 active+clean; 433 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2024-09-10T23:26:12.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:12 smithi073 ceph-mon[35473]: pgmap v973: 129 pgs: 129 active+clean; 433 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2024-09-10T23:26:12.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 331174 28.26 MB/sec execute 488 sec latency 1158.471 ms 2024-09-10T23:26:13.451 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69443 6.00 MB/sec execute 491 sec latency 321.631 ms 2024-09-10T23:26:13.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 331516 28.24 MB/sec execute 489 sec latency 1253.670 ms 2024-09-10T23:26:14.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69563 5.99 MB/sec execute 492 sec latency 296.618 ms 2024-09-10T23:26:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:14.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:14 smithi046 ceph-mon[28128]: pgmap v974: 129 pgs: 129 active+clean; 432 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.4 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2024-09-10T23:26:14.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:14.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:14.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:14.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:14.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:26:14.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:14 smithi073 ceph-mon[35473]: pgmap v974: 129 pgs: 129 active+clean; 432 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.4 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2024-09-10T23:26:14.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 332291 28.26 MB/sec execute 490 sec latency 841.797 ms 2024-09-10T23:26:15.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69731 6.00 MB/sec execute 493 sec latency 94.981 ms 2024-09-10T23:26:15.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 333428 28.34 MB/sec execute 491 sec latency 150.642 ms 2024-09-10T23:26:16.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 69887 5.99 MB/sec execute 494 sec latency 89.079 ms 2024-09-10T23:26:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:16 smithi046 ceph-mon[28128]: pgmap v975: 129 pgs: 129 active+clean; 427 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 159 op/s 2024-09-10T23:26:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:16 smithi073 ceph-mon[35473]: pgmap v975: 129 pgs: 129 active+clean; 427 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 159 op/s 2024-09-10T23:26:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:16.874 INFO:tasks.workunit.client.0.smithi046.stdout: 10 334053 28.36 MB/sec execute 492 sec latency 113.491 ms 2024-09-10T23:26:17.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70018 6.00 MB/sec execute 495 sec latency 95.281 ms 2024-09-10T23:26:17.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 334410 28.33 MB/sec execute 493 sec latency 125.598 ms 2024-09-10T23:26:18.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70138 6.00 MB/sec execute 496 sec latency 93.316 ms 2024-09-10T23:26:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:18 smithi046 ceph-mon[28128]: pgmap v976: 129 pgs: 129 active+clean; 427 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-10T23:26:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:18 smithi073 ceph-mon[35473]: pgmap v976: 129 pgs: 129 active+clean; 427 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-10T23:26:18.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335434 28.36 MB/sec execute 494 sec latency 234.588 ms 2024-09-10T23:26:19.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70240 6.00 MB/sec execute 497 sec latency 297.250 ms 2024-09-10T23:26:19.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335480 28.31 MB/sec execute 495 sec latency 984.185 ms 2024-09-10T23:26:20.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70337 6.00 MB/sec execute 498 sec latency 464.412 ms 2024-09-10T23:26:20.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:20 smithi046 ceph-mon[28128]: pgmap v977: 129 pgs: 129 active+clean; 428 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.9 MiB/s wr, 129 op/s 2024-09-10T23:26:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:20 smithi073 ceph-mon[35473]: pgmap v977: 129 pgs: 129 active+clean; 428 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.9 MiB/s wr, 129 op/s 2024-09-10T23:26:20.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335606 28.26 MB/sec execute 496 sec latency 1380.732 ms 2024-09-10T23:26:21.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70424 6.01 MB/sec execute 499 sec latency 435.281 ms 2024-09-10T23:26:21.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335753 28.24 MB/sec execute 497 sec latency 1157.609 ms 2024-09-10T23:26:22.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70543 6.02 MB/sec execute 500 sec latency 537.541 ms 2024-09-10T23:26:22.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:22 smithi046 ceph-mon[28128]: pgmap v978: 129 pgs: 129 active+clean; 438 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 3.2 MiB/s wr, 163 op/s 2024-09-10T23:26:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:22 smithi073 ceph-mon[35473]: pgmap v978: 129 pgs: 129 active+clean; 438 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 3.2 MiB/s wr, 163 op/s 2024-09-10T23:26:22.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335829 28.19 MB/sec execute 498 sec latency 1350.758 ms 2024-09-10T23:26:23.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70600 6.02 MB/sec execute 501 sec latency 448.335 ms 2024-09-10T23:26:23.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335906 28.15 MB/sec execute 499 sec latency 1323.820 ms 2024-09-10T23:26:24.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70733 6.03 MB/sec execute 502 sec latency 461.158 ms 2024-09-10T23:26:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:24 smithi046 ceph-mon[28128]: pgmap v979: 129 pgs: 129 active+clean; 438 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-09-10T23:26:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:24 smithi073 ceph-mon[35473]: pgmap v979: 129 pgs: 129 active+clean; 438 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-09-10T23:26:24.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 335963 28.10 MB/sec execute 500 sec latency 1302.337 ms 2024-09-10T23:26:25.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70803 6.02 MB/sec execute 503 sec latency 461.730 ms 2024-09-10T23:26:25.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 336019 28.05 MB/sec execute 501 sec latency 1347.954 ms 2024-09-10T23:26:26.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70866 6.02 MB/sec execute 504 sec latency 448.917 ms 2024-09-10T23:26:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:26 smithi046 ceph-mon[28128]: pgmap v980: 129 pgs: 129 active+clean; 444 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.1 MiB/s wr, 116 op/s 2024-09-10T23:26:26.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:26 smithi073 ceph-mon[35473]: pgmap v980: 129 pgs: 129 active+clean; 444 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.1 MiB/s wr, 116 op/s 2024-09-10T23:26:26.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 336167 28.01 MB/sec execute 502 sec latency 1175.672 ms 2024-09-10T23:26:27.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70909 6.01 MB/sec execute 505 sec latency 450.099 ms 2024-09-10T23:26:27.875 INFO:tasks.workunit.client.0.smithi046.stdout: 10 336426 27.99 MB/sec execute 503 sec latency 1328.038 ms 2024-09-10T23:26:28.452 INFO:tasks.workunit.client.1.smithi073.stdout: 10 70977 6.01 MB/sec execute 506 sec latency 429.873 ms 2024-09-10T23:26:28.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:28 smithi046 ceph-mon[28128]: pgmap v981: 129 pgs: 129 active+clean; 447 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.1 MiB/s wr, 101 op/s 2024-09-10T23:26:28.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:28 smithi073 ceph-mon[35473]: pgmap v981: 129 pgs: 129 active+clean; 447 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.1 MiB/s wr, 101 op/s 2024-09-10T23:26:28.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 337375 28.03 MB/sec execute 504 sec latency 233.982 ms 2024-09-10T23:26:29.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71058 6.01 MB/sec execute 507 sec latency 92.740 ms 2024-09-10T23:26:29.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 337770 28.02 MB/sec execute 505 sec latency 153.579 ms 2024-09-10T23:26:30.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71205 6.02 MB/sec execute 508 sec latency 90.227 ms 2024-09-10T23:26:30.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:30 smithi046 ceph-mon[28128]: pgmap v982: 129 pgs: 129 active+clean; 447 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-09-10T23:26:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:30 smithi073 ceph-mon[35473]: pgmap v982: 129 pgs: 129 active+clean; 447 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-09-10T23:26:30.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 338594 28.04 MB/sec execute 506 sec latency 131.170 ms 2024-09-10T23:26:31.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71360 6.03 MB/sec execute 509 sec latency 96.649 ms 2024-09-10T23:26:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:31.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:31.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 339535 28.09 MB/sec execute 507 sec latency 122.524 ms 2024-09-10T23:26:32.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71483 6.03 MB/sec execute 510 sec latency 97.736 ms 2024-09-10T23:26:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:32 smithi046 ceph-mon[28128]: pgmap v983: 129 pgs: 129 active+clean; 451 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.6 MiB/s wr, 113 op/s 2024-09-10T23:26:32.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:32 smithi073 ceph-mon[35473]: pgmap v983: 129 pgs: 129 active+clean; 451 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.5 KiB/s rd, 3.6 MiB/s wr, 113 op/s 2024-09-10T23:26:32.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 340669 28.16 MB/sec execute 508 sec latency 198.072 ms 2024-09-10T23:26:33.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71552 6.02 MB/sec execute 511 sec latency 437.870 ms 2024-09-10T23:26:33.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 340875 28.13 MB/sec execute 509 sec latency 1008.935 ms 2024-09-10T23:26:34.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71581 6.01 MB/sec execute 512 sec latency 435.059 ms 2024-09-10T23:26:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:34 smithi046 ceph-mon[28128]: pgmap v984: 129 pgs: 129 active+clean; 451 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.3 MiB/s wr, 69 op/s 2024-09-10T23:26:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:34 smithi073 ceph-mon[35473]: pgmap v984: 129 pgs: 129 active+clean; 451 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.3 MiB/s wr, 69 op/s 2024-09-10T23:26:34.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 340891 28.07 MB/sec execute 510 sec latency 1467.191 ms 2024-09-10T23:26:35.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71630 6.00 MB/sec execute 513 sec latency 456.354 ms 2024-09-10T23:26:35.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 341024 28.04 MB/sec execute 511 sec latency 1180.086 ms 2024-09-10T23:26:36.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71728 5.99 MB/sec execute 514 sec latency 295.036 ms 2024-09-10T23:26:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:36 smithi046 ceph-mon[28128]: pgmap v985: 129 pgs: 129 active+clean; 450 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 81 op/s 2024-09-10T23:26:36.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:36 smithi073 ceph-mon[35473]: pgmap v985: 129 pgs: 129 active+clean; 450 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 81 op/s 2024-09-10T23:26:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 341431 28.02 MB/sec execute 512 sec latency 135.336 ms 2024-09-10T23:26:37.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71840 5.99 MB/sec execute 515 sec latency 92.534 ms 2024-09-10T23:26:37.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 342482 28.05 MB/sec execute 513 sec latency 133.745 ms 2024-09-10T23:26:38.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 71966 5.98 MB/sec execute 516 sec latency 119.209 ms 2024-09-10T23:26:38.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:38 smithi046 ceph-mon[28128]: pgmap v986: 129 pgs: 129 active+clean; 453 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.5 MiB/s wr, 97 op/s 2024-09-10T23:26:38.913 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:38 smithi073 ceph-mon[35473]: pgmap v986: 129 pgs: 129 active+clean; 453 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.5 MiB/s wr, 97 op/s 2024-09-10T23:26:38.913 INFO:tasks.workunit.client.0.smithi046.stdout: 10 343549 28.14 MB/sec execute 514 sec latency 139.098 ms 2024-09-10T23:26:39.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72101 5.98 MB/sec execute 517 sec latency 103.720 ms 2024-09-10T23:26:39.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 344444 28.17 MB/sec execute 515 sec latency 384.302 ms 2024-09-10T23:26:40.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72243 5.98 MB/sec execute 518 sec latency 106.032 ms 2024-09-10T23:26:40.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:40 smithi046 ceph-mon[28128]: pgmap v987: 129 pgs: 129 active+clean; 452 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.2 MiB/s wr, 80 op/s 2024-09-10T23:26:40.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:40 smithi073 ceph-mon[35473]: pgmap v987: 129 pgs: 129 active+clean; 452 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.2 MiB/s wr, 80 op/s 2024-09-10T23:26:40.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 344608 28.14 MB/sec execute 516 sec latency 504.707 ms 2024-09-10T23:26:41.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72304 5.97 MB/sec execute 519 sec latency 391.135 ms 2024-09-10T23:26:41.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 344618 28.09 MB/sec execute 517 sec latency 1319.969 ms 2024-09-10T23:26:42.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72389 5.98 MB/sec execute 520 sec latency 474.709 ms 2024-09-10T23:26:42.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:42 smithi046 ceph-mon[28128]: pgmap v988: 129 pgs: 129 active+clean; 448 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.9 MiB/s wr, 140 op/s 2024-09-10T23:26:42.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:42 smithi073 ceph-mon[35473]: pgmap v988: 129 pgs: 129 active+clean; 448 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.9 MiB/s wr, 140 op/s 2024-09-10T23:26:42.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 344638 28.03 MB/sec execute 518 sec latency 1332.997 ms 2024-09-10T23:26:43.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72491 5.98 MB/sec execute 521 sec latency 392.441 ms 2024-09-10T23:26:43.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 345045 28.01 MB/sec execute 519 sec latency 712.972 ms 2024-09-10T23:26:44.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72627 5.98 MB/sec execute 522 sec latency 90.722 ms 2024-09-10T23:26:44.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:44 smithi046 ceph-mon[28128]: pgmap v989: 129 pgs: 129 active+clean; 447 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 2.2 MiB/s wr, 115 op/s 2024-09-10T23:26:44.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:44 smithi073 ceph-mon[35473]: pgmap v989: 129 pgs: 129 active+clean; 447 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.5 KiB/s rd, 2.2 MiB/s wr, 115 op/s 2024-09-10T23:26:44.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 345841 28.03 MB/sec execute 520 sec latency 278.863 ms 2024-09-10T23:26:45.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72780 5.99 MB/sec execute 523 sec latency 92.304 ms 2024-09-10T23:26:45.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 346722 28.08 MB/sec execute 521 sec latency 220.003 ms 2024-09-10T23:26:46.453 INFO:tasks.workunit.client.1.smithi073.stdout: 10 72916 5.99 MB/sec execute 524 sec latency 87.324 ms 2024-09-10T23:26:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:46 smithi046 ceph-mon[28128]: pgmap v990: 129 pgs: 129 active+clean; 442 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 2.8 MiB/s wr, 155 op/s 2024-09-10T23:26:46.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:46.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:46 smithi073 ceph-mon[35473]: pgmap v990: 129 pgs: 129 active+clean; 442 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 2.8 MiB/s wr, 155 op/s 2024-09-10T23:26:46.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:26:46.876 INFO:tasks.workunit.client.0.smithi046.stdout: 10 347987 28.16 MB/sec execute 522 sec latency 151.776 ms 2024-09-10T23:26:47.454 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73064 5.98 MB/sec execute 525 sec latency 85.565 ms 2024-09-10T23:26:47.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 348288 28.14 MB/sec execute 523 sec latency 156.827 ms 2024-09-10T23:26:48.454 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73215 5.98 MB/sec execute 526 sec latency 153.506 ms 2024-09-10T23:26:48.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:48 smithi046 ceph-mon[28128]: pgmap v991: 129 pgs: 129 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.6 MiB/s wr, 155 op/s 2024-09-10T23:26:48.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:48 smithi073 ceph-mon[35473]: pgmap v991: 129 pgs: 129 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.6 MiB/s wr, 155 op/s 2024-09-10T23:26:48.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 348395 28.10 MB/sec execute 524 sec latency 800.056 ms 2024-09-10T23:26:49.454 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73291 5.97 MB/sec execute 527 sec latency 422.065 ms 2024-09-10T23:26:49.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 348405 28.04 MB/sec execute 525 sec latency 1337.830 ms 2024-09-10T23:26:50.454 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73397 5.97 MB/sec execute 528 sec latency 332.413 ms 2024-09-10T23:26:50.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:50 smithi046 ceph-mon[28128]: pgmap v992: 129 pgs: 129 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-10T23:26:50.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:50 smithi073 ceph-mon[35473]: pgmap v992: 129 pgs: 129 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-10T23:26:50.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 348410 27.99 MB/sec execute 526 sec latency 1600.672 ms 2024-09-10T23:26:51.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73509 5.96 MB/sec execute 529 sec latency 371.583 ms 2024-09-10T23:26:51.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 348918 27.99 MB/sec execute 527 sec latency 992.306 ms 2024-09-10T23:26:52.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73637 5.97 MB/sec execute 530 sec latency 80.393 ms 2024-09-10T23:26:52.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:52 smithi046 ceph-mon[28128]: pgmap v993: 129 pgs: 129 active+clean; 444 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-09-10T23:26:52.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:52 smithi073 ceph-mon[35473]: pgmap v993: 129 pgs: 129 active+clean; 444 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-09-10T23:26:52.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 350073 28.05 MB/sec execute 528 sec latency 134.119 ms 2024-09-10T23:26:53.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73760 5.97 MB/sec execute 531 sec latency 101.914 ms 2024-09-10T23:26:53.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 351304 28.12 MB/sec execute 529 sec latency 129.827 ms 2024-09-10T23:26:54.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 73920 5.98 MB/sec execute 532 sec latency 97.924 ms 2024-09-10T23:26:54.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:54 smithi046 ceph-mon[28128]: pgmap v994: 129 pgs: 129 active+clean; 445 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.8 MiB/s wr, 116 op/s 2024-09-10T23:26:54.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:54 smithi073 ceph-mon[35473]: pgmap v994: 129 pgs: 129 active+clean; 445 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.8 MiB/s wr, 116 op/s 2024-09-10T23:26:54.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 351826 28.13 MB/sec execute 530 sec latency 179.909 ms 2024-09-10T23:26:55.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74119 6.00 MB/sec execute 533 sec latency 90.507 ms 2024-09-10T23:26:55.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 352138 28.10 MB/sec execute 531 sec latency 172.452 ms 2024-09-10T23:26:56.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74237 6.01 MB/sec execute 534 sec latency 489.644 ms 2024-09-10T23:26:56.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:56 smithi046 ceph-mon[28128]: pgmap v995: 129 pgs: 129 active+clean; 450 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 149 op/s 2024-09-10T23:26:56.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:56 smithi073 ceph-mon[35473]: pgmap v995: 129 pgs: 129 active+clean; 450 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 149 op/s 2024-09-10T23:26:56.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 352370 28.08 MB/sec execute 532 sec latency 996.246 ms 2024-09-10T23:26:57.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74339 6.01 MB/sec execute 535 sec latency 290.357 ms 2024-09-10T23:26:57.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 352425 28.03 MB/sec execute 533 sec latency 1350.013 ms 2024-09-10T23:26:58.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74409 6.01 MB/sec execute 536 sec latency 466.252 ms 2024-09-10T23:26:58.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:26:58 smithi046 ceph-mon[28128]: pgmap v996: 129 pgs: 129 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-10T23:26:58.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:26:58 smithi073 ceph-mon[35473]: pgmap v996: 129 pgs: 129 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-10T23:26:58.877 INFO:tasks.workunit.client.0.smithi046.stdout: 10 352978 28.01 MB/sec execute 534 sec latency 1038.758 ms 2024-09-10T23:26:59.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74531 6.02 MB/sec execute 537 sec latency 92.898 ms 2024-09-10T23:26:59.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 353951 28.08 MB/sec execute 535 sec latency 247.965 ms 2024-09-10T23:27:00.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74577 6.01 MB/sec execute 538 sec latency 419.816 ms 2024-09-10T23:27:00.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:00 smithi046 ceph-mon[28128]: pgmap v997: 129 pgs: 129 active+clean; 456 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.8 MiB/s wr, 113 op/s 2024-09-10T23:27:00.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:00 smithi073 ceph-mon[35473]: pgmap v997: 129 pgs: 129 active+clean; 456 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.8 MiB/s wr, 113 op/s 2024-09-10T23:27:00.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 354972 28.13 MB/sec execute 536 sec latency 284.223 ms 2024-09-10T23:27:01.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74679 6.01 MB/sec execute 539 sec latency 97.369 ms 2024-09-10T23:27:01.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:01.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:01.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 355378 28.12 MB/sec execute 537 sec latency 151.216 ms 2024-09-10T23:27:02.455 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74816 6.02 MB/sec execute 540 sec latency 74.627 ms 2024-09-10T23:27:02.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:02 smithi046 ceph-mon[28128]: pgmap v998: 129 pgs: 129 active+clean; 464 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.6 MiB/s wr, 138 op/s 2024-09-10T23:27:02.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:02 smithi073 ceph-mon[35473]: pgmap v998: 129 pgs: 129 active+clean; 464 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.7 KiB/s rd, 3.6 MiB/s wr, 138 op/s 2024-09-10T23:27:02.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 355913 28.12 MB/sec execute 538 sec latency 118.764 ms 2024-09-10T23:27:03.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 74956 6.03 MB/sec execute 541 sec latency 91.803 ms 2024-09-10T23:27:03.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 356505 28.11 MB/sec execute 539 sec latency 452.424 ms 2024-09-10T23:27:04.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75028 6.02 MB/sec execute 542 sec latency 428.300 ms 2024-09-10T23:27:04.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:04 smithi046 ceph-mon[28128]: pgmap v999: 129 pgs: 129 active+clean; 460 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.2 MiB/s wr, 90 op/s 2024-09-10T23:27:04.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:04 smithi073 ceph-mon[35473]: pgmap v999: 129 pgs: 129 active+clean; 460 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.4 KiB/s rd, 3.2 MiB/s wr, 90 op/s 2024-09-10T23:27:04.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 356636 28.07 MB/sec execute 540 sec latency 923.039 ms 2024-09-10T23:27:05.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75083 6.02 MB/sec execute 543 sec latency 462.199 ms 2024-09-10T23:27:05.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 356640 28.02 MB/sec execute 541 sec latency 1060.604 ms 2024-09-10T23:27:06.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75144 6.01 MB/sec execute 544 sec latency 423.794 ms 2024-09-10T23:27:06.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:06 smithi046 ceph-mon[28128]: pgmap v1000: 129 pgs: 129 active+clean; 444 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.7 MiB/s wr, 101 op/s 2024-09-10T23:27:06.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:06 smithi073 ceph-mon[35473]: pgmap v1000: 129 pgs: 129 active+clean; 444 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.7 MiB/s wr, 101 op/s 2024-09-10T23:27:06.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 357725 28.09 MB/sec execute 542 sec latency 743.353 ms 2024-09-10T23:27:07.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75249 6.00 MB/sec execute 545 sec latency 96.670 ms 2024-09-10T23:27:07.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 358736 28.14 MB/sec execute 543 sec latency 142.998 ms 2024-09-10T23:27:08.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75357 6.00 MB/sec execute 546 sec latency 111.296 ms 2024-09-10T23:27:08.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:08 smithi046 ceph-mon[28128]: pgmap v1001: 129 pgs: 129 active+clean; 443 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 101 op/s 2024-09-10T23:27:08.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:08 smithi073 ceph-mon[35473]: pgmap v1001: 129 pgs: 129 active+clean; 443 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 101 op/s 2024-09-10T23:27:08.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 359106 28.12 MB/sec execute 544 sec latency 113.433 ms 2024-09-10T23:27:09.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75458 5.99 MB/sec execute 547 sec latency 112.575 ms 2024-09-10T23:27:09.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 359919 28.14 MB/sec execute 545 sec latency 142.319 ms 2024-09-10T23:27:10.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75585 5.99 MB/sec execute 548 sec latency 116.832 ms 2024-09-10T23:27:10.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:10 smithi046 ceph-mon[28128]: pgmap v1002: 129 pgs: 129 active+clean; 443 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.8 MiB/s wr, 90 op/s 2024-09-10T23:27:10.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:10 smithi073 ceph-mon[35473]: pgmap v1002: 129 pgs: 129 active+clean; 443 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.8 MiB/s wr, 90 op/s 2024-09-10T23:27:10.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 360935 28.20 MB/sec execute 546 sec latency 249.823 ms 2024-09-10T23:27:11.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75708 5.99 MB/sec execute 549 sec latency 220.144 ms 2024-09-10T23:27:11.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 361275 28.19 MB/sec execute 547 sec latency 783.839 ms 2024-09-10T23:27:12.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75772 5.98 MB/sec execute 550 sec latency 444.980 ms 2024-09-10T23:27:12.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:12 smithi046 ceph-mon[28128]: pgmap v1003: 129 pgs: 129 active+clean; 439 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 105 op/s 2024-09-10T23:27:12.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:12 smithi073 ceph-mon[35473]: pgmap v1003: 129 pgs: 129 active+clean; 439 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 105 op/s 2024-09-10T23:27:12.878 INFO:tasks.workunit.client.0.smithi046.stdout: 10 361331 28.14 MB/sec execute 548 sec latency 1289.069 ms 2024-09-10T23:27:13.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75850 5.97 MB/sec execute 551 sec latency 366.459 ms 2024-09-10T23:27:13.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 361769 28.13 MB/sec execute 549 sec latency 1168.977 ms 2024-09-10T23:27:14.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 75977 5.98 MB/sec execute 552 sec latency 424.411 ms 2024-09-10T23:27:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:14 smithi046 ceph-mon[28128]: pgmap v1004: 129 pgs: 129 active+clean; 441 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 103 op/s 2024-09-10T23:27:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:27:14.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:14 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:27:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:14 smithi073 ceph-mon[35473]: pgmap v1004: 129 pgs: 129 active+clean; 441 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 103 op/s 2024-09-10T23:27:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:27:14.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:14 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:27:14.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 362297 28.13 MB/sec execute 550 sec latency 221.225 ms 2024-09-10T23:27:15.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76046 5.98 MB/sec execute 553 sec latency 424.013 ms 2024-09-10T23:27:15.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 362581 28.11 MB/sec execute 551 sec latency 221.735 ms 2024-09-10T23:27:16.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76173 5.98 MB/sec execute 554 sec latency 120.189 ms 2024-09-10T23:27:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:16 smithi046 ceph-mon[28128]: pgmap v1005: 129 pgs: 129 active+clean; 436 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.0 MiB/s wr, 151 op/s 2024-09-10T23:27:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:16.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:27:16.824 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:16 smithi073 ceph-mon[35473]: pgmap v1005: 129 pgs: 129 active+clean; 436 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.0 MiB/s wr, 151 op/s 2024-09-10T23:27:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:27:16.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:16.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 363130 28.11 MB/sec execute 552 sec latency 328.390 ms 2024-09-10T23:27:17.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76316 5.99 MB/sec execute 555 sec latency 76.359 ms 2024-09-10T23:27:17.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 364233 28.16 MB/sec execute 553 sec latency 127.698 ms 2024-09-10T23:27:18.456 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76460 5.99 MB/sec execute 556 sec latency 94.546 ms 2024-09-10T23:27:18.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:18 smithi046 ceph-mon[28128]: pgmap v1006: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 2.8 MiB/s wr, 152 op/s 2024-09-10T23:27:18.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:18 smithi073 ceph-mon[35473]: pgmap v1006: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 2.8 MiB/s wr, 152 op/s 2024-09-10T23:27:18.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 365365 28.22 MB/sec execute 554 sec latency 146.690 ms 2024-09-10T23:27:19.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76547 5.98 MB/sec execute 557 sec latency 274.020 ms 2024-09-10T23:27:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 365473 28.18 MB/sec execute 555 sec latency 1031.467 ms 2024-09-10T23:27:20.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76617 5.97 MB/sec execute 558 sec latency 431.770 ms 2024-09-10T23:27:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:20 smithi046 ceph-mon[28128]: pgmap v1007: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-09-10T23:27:20.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:20 smithi073 ceph-mon[35473]: pgmap v1007: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-09-10T23:27:20.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 365487 28.13 MB/sec execute 556 sec latency 1261.842 ms 2024-09-10T23:27:21.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76757 5.97 MB/sec execute 559 sec latency 268.061 ms 2024-09-10T23:27:21.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 365886 28.13 MB/sec execute 557 sec latency 1278.352 ms 2024-09-10T23:27:22.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 76899 5.97 MB/sec execute 560 sec latency 91.165 ms 2024-09-10T23:27:22.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:22 smithi046 ceph-mon[28128]: pgmap v1008: 129 pgs: 129 active+clean; 433 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.4 MiB/s wr, 164 op/s 2024-09-10T23:27:22.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:22 smithi073 ceph-mon[35473]: pgmap v1008: 129 pgs: 129 active+clean; 433 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.4 MiB/s wr, 164 op/s 2024-09-10T23:27:22.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 366328 28.11 MB/sec execute 558 sec latency 122.810 ms 2024-09-10T23:27:23.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 77058 5.97 MB/sec execute 561 sec latency 81.046 ms 2024-09-10T23:27:23.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 367391 28.15 MB/sec execute 559 sec latency 170.067 ms 2024-09-10T23:27:24.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 77185 5.97 MB/sec execute 562 sec latency 78.412 ms 2024-09-10T23:27:24.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:24 smithi046 ceph-mon[28128]: pgmap v1009: 129 pgs: 129 active+clean; 433 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 MiB/s wr, 149 op/s 2024-09-10T23:27:24.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:24 smithi073 ceph-mon[35473]: pgmap v1009: 129 pgs: 129 active+clean; 433 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 MiB/s wr, 149 op/s 2024-09-10T23:27:24.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 368437 28.22 MB/sec execute 560 sec latency 181.012 ms 2024-09-10T23:27:25.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 77309 5.97 MB/sec execute 563 sec latency 92.012 ms 2024-09-10T23:27:25.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 369302 28.26 MB/sec execute 561 sec latency 475.548 ms 2024-09-10T23:27:26.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 77478 5.98 MB/sec execute 564 sec latency 102.522 ms 2024-09-10T23:27:26.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:26 smithi046 ceph-mon[28128]: pgmap v1010: 129 pgs: 129 active+clean; 436 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.2 MiB/s wr, 143 op/s 2024-09-10T23:27:26.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:26 smithi073 ceph-mon[35473]: pgmap v1010: 129 pgs: 129 active+clean; 436 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 2.2 MiB/s wr, 143 op/s 2024-09-10T23:27:26.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 369708 28.24 MB/sec execute 562 sec latency 508.269 ms 2024-09-10T23:27:27.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 77665 6.00 MB/sec execute 565 sec latency 92.221 ms 2024-09-10T23:27:27.879 INFO:tasks.workunit.client.0.smithi046.stdout: 10 370473 28.25 MB/sec execute 563 sec latency 112.363 ms 2024-09-10T23:27:28.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 77857 6.02 MB/sec execute 566 sec latency 106.623 ms 2024-09-10T23:27:28.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:28 smithi046 ceph-mon[28128]: pgmap v1011: 129 pgs: 129 active+clean; 441 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-10T23:27:28.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:28 smithi073 ceph-mon[35473]: pgmap v1011: 129 pgs: 129 active+clean; 441 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-10T23:27:28.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 371578 28.32 MB/sec execute 564 sec latency 127.722 ms 2024-09-10T23:27:29.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78006 6.02 MB/sec execute 567 sec latency 109.418 ms 2024-09-10T23:27:29.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 372832 28.39 MB/sec execute 565 sec latency 141.777 ms 2024-09-10T23:27:30.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78110 6.03 MB/sec execute 568 sec latency 110.545 ms 2024-09-10T23:27:30.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:30 smithi046 ceph-mon[28128]: pgmap v1012: 129 pgs: 129 active+clean; 443 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.2 MiB/s wr, 117 op/s 2024-09-10T23:27:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:30 smithi073 ceph-mon[35473]: pgmap v1012: 129 pgs: 129 active+clean; 443 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.2 MiB/s wr, 117 op/s 2024-09-10T23:27:30.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 373208 28.38 MB/sec execute 566 sec latency 150.789 ms 2024-09-10T23:27:31.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78188 6.02 MB/sec execute 569 sec latency 91.140 ms 2024-09-10T23:27:31.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:31.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:31.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 373887 28.38 MB/sec execute 567 sec latency 116.572 ms 2024-09-10T23:27:32.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78297 6.03 MB/sec execute 570 sec latency 97.725 ms 2024-09-10T23:27:32.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:32 smithi046 ceph-mon[28128]: pgmap v1013: 129 pgs: 129 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.8 MiB/s wr, 159 op/s 2024-09-10T23:27:32.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:32 smithi073 ceph-mon[35473]: pgmap v1013: 129 pgs: 129 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.0 KiB/s rd, 3.8 MiB/s wr, 159 op/s 2024-09-10T23:27:32.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 375076 28.45 MB/sec execute 568 sec latency 128.469 ms 2024-09-10T23:27:33.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78450 6.04 MB/sec execute 571 sec latency 102.811 ms 2024-09-10T23:27:33.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 376247 28.51 MB/sec execute 569 sec latency 169.919 ms 2024-09-10T23:27:34.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78585 6.04 MB/sec execute 572 sec latency 102.745 ms 2024-09-10T23:27:34.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:34 smithi046 ceph-mon[28128]: pgmap v1014: 129 pgs: 129 active+clean; 456 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.4 MiB/s wr, 109 op/s 2024-09-10T23:27:34.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:34 smithi073 ceph-mon[35473]: pgmap v1014: 129 pgs: 129 active+clean; 456 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.6 KiB/s rd, 3.4 MiB/s wr, 109 op/s 2024-09-10T23:27:34.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 376758 28.51 MB/sec execute 570 sec latency 133.656 ms 2024-09-10T23:27:35.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78692 6.04 MB/sec execute 573 sec latency 97.919 ms 2024-09-10T23:27:35.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 377484 28.52 MB/sec execute 571 sec latency 133.405 ms 2024-09-10T23:27:36.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78790 6.03 MB/sec execute 574 sec latency 119.497 ms 2024-09-10T23:27:36.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:36 smithi046 ceph-mon[28128]: pgmap v1015: 129 pgs: 129 active+clean; 456 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.1 MiB/s wr, 121 op/s 2024-09-10T23:27:36.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:36 smithi073 ceph-mon[35473]: pgmap v1015: 129 pgs: 129 active+clean; 456 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.1 MiB/s wr, 121 op/s 2024-09-10T23:27:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 377908 28.50 MB/sec execute 572 sec latency 681.844 ms 2024-09-10T23:27:37.457 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78871 6.03 MB/sec execute 575 sec latency 340.873 ms 2024-09-10T23:27:37.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 378684 28.53 MB/sec execute 573 sec latency 967.468 ms 2024-09-10T23:27:38.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 78972 6.02 MB/sec execute 576 sec latency 102.574 ms 2024-09-10T23:27:38.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:38 smithi046 ceph-mon[28128]: pgmap v1016: 129 pgs: 129 active+clean; 460 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 4.6 MiB/s wr, 146 op/s 2024-09-10T23:27:38.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:38 smithi073 ceph-mon[35473]: pgmap v1016: 129 pgs: 129 active+clean; 460 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 4.6 MiB/s wr, 146 op/s 2024-09-10T23:27:38.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 379915 28.61 MB/sec execute 574 sec latency 136.024 ms 2024-09-10T23:27:39.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79093 6.02 MB/sec execute 577 sec latency 101.320 ms 2024-09-10T23:27:39.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 380346 28.60 MB/sec execute 575 sec latency 103.980 ms 2024-09-10T23:27:40.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79231 6.01 MB/sec execute 578 sec latency 105.120 ms 2024-09-10T23:27:40.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:40 smithi046 ceph-mon[28128]: pgmap v1017: 129 pgs: 129 active+clean; 460 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.8 MiB/s wr, 115 op/s 2024-09-10T23:27:40.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:40 smithi073 ceph-mon[35473]: pgmap v1017: 129 pgs: 129 active+clean; 460 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.8 MiB/s wr, 115 op/s 2024-09-10T23:27:40.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 381051 28.60 MB/sec execute 576 sec latency 129.147 ms 2024-09-10T23:27:41.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79332 6.01 MB/sec execute 579 sec latency 451.901 ms 2024-09-10T23:27:41.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 381969 28.65 MB/sec execute 577 sec latency 296.823 ms 2024-09-10T23:27:42.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79453 6.01 MB/sec execute 580 sec latency 202.321 ms 2024-09-10T23:27:42.831 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:42 smithi073 ceph-mon[35473]: pgmap v1018: 129 pgs: 129 active+clean; 454 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 135 op/s 2024-09-10T23:27:42.880 INFO:tasks.workunit.client.0.smithi046.stdout: 10 382587 28.66 MB/sec execute 578 sec latency 566.797 ms 2024-09-10T23:27:43.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:42 smithi046 ceph-mon[28128]: pgmap v1018: 129 pgs: 129 active+clean; 454 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 135 op/s 2024-09-10T23:27:43.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79597 6.02 MB/sec execute 581 sec latency 116.632 ms 2024-09-10T23:27:43.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 383564 28.70 MB/sec execute 579 sec latency 134.038 ms 2024-09-10T23:27:44.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79744 6.02 MB/sec execute 582 sec latency 82.688 ms 2024-09-10T23:27:44.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:44 smithi073 ceph-mon[35473]: pgmap v1019: 129 pgs: 129 active+clean; 456 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 119 op/s 2024-09-10T23:27:44.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 383936 28.68 MB/sec execute 580 sec latency 116.289 ms 2024-09-10T23:27:45.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:44 smithi046 ceph-mon[28128]: pgmap v1019: 129 pgs: 129 active+clean; 456 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 119 op/s 2024-09-10T23:27:45.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 79888 6.03 MB/sec execute 583 sec latency 93.615 ms 2024-09-10T23:27:45.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 384695 28.69 MB/sec execute 581 sec latency 193.168 ms 2024-09-10T23:27:46.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80045 6.03 MB/sec execute 584 sec latency 97.002 ms 2024-09-10T23:27:46.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 385838 28.76 MB/sec execute 582 sec latency 161.193 ms 2024-09-10T23:27:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:46 smithi046 ceph-mon[28128]: pgmap v1020: 129 pgs: 129 active+clean; 449 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2024-09-10T23:27:47.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:46 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:46 smithi073 ceph-mon[35473]: pgmap v1020: 129 pgs: 129 active+clean; 449 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2024-09-10T23:27:47.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:46 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:27:47.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80192 6.03 MB/sec execute 585 sec latency 87.883 ms 2024-09-10T23:27:47.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 386741 28.79 MB/sec execute 583 sec latency 477.581 ms 2024-09-10T23:27:48.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80292 6.02 MB/sec execute 586 sec latency 446.809 ms 2024-09-10T23:27:48.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 387139 28.79 MB/sec execute 584 sec latency 946.530 ms 2024-09-10T23:27:49.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:48 smithi046 ceph-mon[28128]: pgmap v1021: 129 pgs: 129 active+clean; 447 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 171 op/s 2024-09-10T23:27:49.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:48 smithi073 ceph-mon[35473]: pgmap v1021: 129 pgs: 129 active+clean; 447 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 171 op/s 2024-09-10T23:27:49.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80449 6.02 MB/sec execute 587 sec latency 89.399 ms 2024-09-10T23:27:49.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 387513 28.77 MB/sec execute 585 sec latency 116.369 ms 2024-09-10T23:27:50.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80584 6.02 MB/sec execute 588 sec latency 89.401 ms 2024-09-10T23:27:50.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 388593 28.80 MB/sec execute 586 sec latency 112.377 ms 2024-09-10T23:27:50.998 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:50 smithi073 ceph-mon[35473]: pgmap v1022: 129 pgs: 129 active+clean; 447 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 131 op/s 2024-09-10T23:27:51.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:50 smithi046 ceph-mon[28128]: pgmap v1022: 129 pgs: 129 active+clean; 447 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 131 op/s 2024-09-10T23:27:51.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80714 6.02 MB/sec execute 589 sec latency 103.167 ms 2024-09-10T23:27:51.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 389561 28.86 MB/sec execute 587 sec latency 298.302 ms 2024-09-10T23:27:52.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80842 6.02 MB/sec execute 590 sec latency 103.270 ms 2024-09-10T23:27:52.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 390638 28.91 MB/sec execute 588 sec latency 228.093 ms 2024-09-10T23:27:53.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:52 smithi046 ceph-mon[28128]: pgmap v1023: 129 pgs: 129 active+clean; 440 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.7 MiB/s wr, 180 op/s 2024-09-10T23:27:53.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:52 smithi073 ceph-mon[35473]: pgmap v1023: 129 pgs: 129 active+clean; 440 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.7 KiB/s rd, 2.7 MiB/s wr, 180 op/s 2024-09-10T23:27:53.458 INFO:tasks.workunit.client.1.smithi073.stdout: 10 80997 6.03 MB/sec execute 591 sec latency 104.978 ms 2024-09-10T23:27:53.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 390894 28.88 MB/sec execute 589 sec latency 319.118 ms 2024-09-10T23:27:54.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81097 6.03 MB/sec execute 592 sec latency 470.845 ms 2024-09-10T23:27:54.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 390896 28.83 MB/sec execute 590 sec latency 1185.867 ms 2024-09-10T23:27:55.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:54 smithi046 ceph-mon[28128]: pgmap v1024: 129 pgs: 129 active+clean; 436 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.4 MiB/s wr, 158 op/s 2024-09-10T23:27:55.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:54 smithi073 ceph-mon[35473]: pgmap v1024: 129 pgs: 129 active+clean; 436 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.4 MiB/s wr, 158 op/s 2024-09-10T23:27:55.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81148 6.03 MB/sec execute 593 sec latency 473.814 ms 2024-09-10T23:27:55.881 INFO:tasks.workunit.client.0.smithi046.stdout: 10 390939 28.79 MB/sec execute 591 sec latency 1359.955 ms 2024-09-10T23:27:56.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81263 6.04 MB/sec execute 594 sec latency 463.318 ms 2024-09-10T23:27:56.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 390987 28.75 MB/sec execute 592 sec latency 1300.764 ms 2024-09-10T23:27:57.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:56 smithi046 ceph-mon[28128]: pgmap v1025: 129 pgs: 129 active+clean; 432 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.9 MiB/s wr, 148 op/s 2024-09-10T23:27:57.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:56 smithi073 ceph-mon[35473]: pgmap v1025: 129 pgs: 129 active+clean; 432 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.9 MiB/s wr, 148 op/s 2024-09-10T23:27:57.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81342 6.04 MB/sec execute 595 sec latency 432.059 ms 2024-09-10T23:27:57.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 390990 28.70 MB/sec execute 593 sec latency 1430.525 ms 2024-09-10T23:27:58.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81430 6.04 MB/sec execute 596 sec latency 460.991 ms 2024-09-10T23:27:58.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391003 28.65 MB/sec execute 594 sec latency 1186.563 ms 2024-09-10T23:27:59.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:27:58 smithi046 ceph-mon[28128]: pgmap v1026: 129 pgs: 129 active+clean; 437 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2024-09-10T23:27:59.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:27:58 smithi073 ceph-mon[35473]: pgmap v1026: 129 pgs: 129 active+clean; 437 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2024-09-10T23:27:59.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81505 6.04 MB/sec execute 597 sec latency 461.694 ms 2024-09-10T23:27:59.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391005 28.60 MB/sec execute 595 sec latency 1342.409 ms 2024-09-10T23:28:00.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81583 6.04 MB/sec execute 598 sec latency 467.071 ms 2024-09-10T23:28:00.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391027 28.55 MB/sec execute 596 sec latency 1310.719 ms 2024-09-10T23:28:00.999 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:00 smithi073 ceph-mon[35473]: pgmap v1027: 129 pgs: 129 active+clean; 439 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.7 MiB/s wr, 111 op/s 2024-09-10T23:28:01.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:00 smithi046 ceph-mon[28128]: pgmap v1027: 129 pgs: 129 active+clean; 439 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.7 MiB/s wr, 111 op/s 2024-09-10T23:28:01.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 81646 6.04 MB/sec execute 599 sec latency 388.328 ms 2024-09-10T23:28:01.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391057 28.51 MB/sec execute 597 sec latency 1199.793 ms 2024-09-10T23:28:02.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:01 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:28:02.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:01 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:28:02.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 cleanup 600 sec 2024-09-10T23:28:02.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391064 28.46 MB/sec execute 598 sec latency 1326.159 ms 2024-09-10T23:28:03.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:02 smithi046 ceph-mon[28128]: pgmap v1028: 129 pgs: 129 active+clean; 446 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 4.8 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-10T23:28:03.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:02 smithi073 ceph-mon[35473]: pgmap v1028: 129 pgs: 129 active+clean; 446 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 4.8 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-10T23:28:03.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 cleanup 601 sec 2024-09-10T23:28:03.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391088 28.41 MB/sec execute 599 sec latency 1219.284 ms 2024-09-10T23:28:04.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 cleanup 602 sec 2024-09-10T23:28:04.882 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 600 sec 2024-09-10T23:28:05.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:04 smithi046 ceph-mon[28128]: pgmap v1029: 129 pgs: 129 active+clean; 446 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.8 MiB/s wr, 78 op/s 2024-09-10T23:28:05.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:04 smithi073 ceph-mon[35473]: pgmap v1029: 129 pgs: 129 active+clean; 446 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.8 MiB/s wr, 78 op/s 2024-09-10T23:28:05.459 INFO:tasks.workunit.client.1.smithi073.stdout: 10 cleanup 603 sec 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 601 sec 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 546120 0.095 391.051 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: Close 401036 0.004 3.507 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 23147 0.332 385.446 2024-09-10T23:28:05.859 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 110380 0.676 414.186 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 495239 0.046 2259.247 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 86345 0.002 1.027 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 90794 0.005 1.570 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 44545 1.876 434.380 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: Find 191403 0.057 342.693 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 269830 0.371 429.721 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 856835 0.023 402.356 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: LockX 1780 0.006 0.033 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: UnlockX 1780 0.004 0.064 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 38316 146.831 3403.095 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-10T23:28:05.860 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 28.4138 MB/sec 10 clients 10 procs max_latency=3403.102 ms 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: 0 cleanup 604 sec 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Operation Count AvgLat MaxLat 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: ---------------------------------------- 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: NTCreateX 116630 13.555 784.779 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Close 85597 0.197 12.097 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Rename 4940 33.775 1031.700 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Unlink 23564 12.209 501.277 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Qpathinfo 105605 7.421 1216.827 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Qfileinfo 18416 0.414 4.357 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Qfsinfo 19285 1.987 2097.321 2024-09-10T23:28:06.013 INFO:tasks.workunit.client.1.smithi073.stdout: Sfileinfo 9534 3.104 376.629 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: Find 40733 72.096 1109.085 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: WriteX 57590 0.752 645.612 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: ReadX 182379 0.009 1.788 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: LockX 380 3.694 183.897 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: UnlockX 380 3.639 353.584 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: Flush 8182 12.328 1160.964 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout: 2024-09-10T23:28:06.014 INFO:tasks.workunit.client.1.smithi073.stdout:Throughput 6.03594 MB/sec 10 clients 10 procs max_latency=2097.333 ms 2024-09-10T23:28:06.021 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:28:06.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-10T23:28:06.265 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:28:06.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:28:07.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:06 smithi046 ceph-mon[28128]: pgmap v1030: 129 pgs: 129 active+clean; 440 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.0 MiB/s wr, 83 op/s 2024-09-10T23:28:07.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:06 smithi073 ceph-mon[35473]: pgmap v1030: 129 pgs: 129 active+clean; 440 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.0 MiB/s wr, 83 op/s 2024-09-10T23:28:07.286 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2024-09-10T23:28:07.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-10T23:28:08.257 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:08.563 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-09-10T23:28:08.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T23:28:08.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:08 smithi046 ceph-mon[28128]: pgmap v1031: 129 pgs: 129 active+clean; 427 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2024-09-10T23:28:09.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:08 smithi073 ceph-mon[35473]: pgmap v1031: 129 pgs: 129 active+clean; 427 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2024-09-10T23:28:09.837 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:09.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:28:09.894 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:28:09.894 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:09.929 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:28:09.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T23:28:09.996 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T23:28:09.996 INFO:teuthology.run_tasks:Running task pexec... 2024-09-10T23:28:10.009 INFO:teuthology.task.pexec:Executing custom commands... 2024-09-10T23:28:10.010 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi046.front.sepia.ceph.com 2024-09-10T23:28:10.010 DEBUG:teuthology.orchestra.run.smithi046:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-10T23:28:10.011 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T23:28:10.011 DEBUG:teuthology.orchestra.run.smithi073:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-10T23:28:10.999 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:10 smithi073 ceph-mon[35473]: pgmap v1032: 129 pgs: 129 active+clean; 394 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.7 MiB/s wr, 64 op/s 2024-09-10T23:28:11.035 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T23:28:11.036 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T23:28:11.036 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-10T23:28:11.036 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:Removing: 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:Removing unused dependencies: 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:Remove 2 Packages 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:Freed space: 5.5 M 2024-09-10T23:28:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T23:28:11.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:10 smithi046 ceph-mon[28128]: pgmap v1032: 129 pgs: 129 active+clean; 394 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.7 MiB/s wr, 64 op/s 2024-09-10T23:28:11.074 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T23:28:11.074 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T23:28:11.086 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout:Removing: 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout:Removing unused dependencies: 2024-09-10T23:28:11.087 INFO:teuthology.orchestra.run.smithi073.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout:Remove 2 Packages 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout:Freed space: 5.5 M 2024-09-10T23:28:11.088 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T23:28:11.123 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T23:28:11.123 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T23:28:11.181 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T23:28:11.181 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T23:28:11.230 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T23:28:11.230 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T23:28:11.488 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T23:28:11.492 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T23:28:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-10T23:28:11.612 INFO:teuthology.orchestra.run.smithi046.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-10T23:28:11.664 INFO:teuthology.orchestra.run.smithi073.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi046.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T23:28:12.573 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T23:28:12.573 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-10T23:28:12.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:12 smithi046 ceph-mon[28128]: pgmap v1033: 129 pgs: 129 active+clean; 238 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 11 KiB/s rd, 1.8 MiB/s wr, 123 op/s 2024-09-10T23:28:13.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:12 smithi073 ceph-mon[35473]: pgmap v1033: 129 pgs: 129 active+clean; 238 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 11 KiB/s rd, 1.8 MiB/s wr, 123 op/s 2024-09-10T23:28:13.150 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-10T23:28:13.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:13.150 INFO:teuthology.orchestra.run.smithi046.stdout:Removed: 2024-09-10T23:28:13.150 INFO:teuthology.orchestra.run.smithi046.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T23:28:13.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:13.151 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T23:28:14.239 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:38:18 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T23:28:14.388 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-10T23:28:14.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:14.390 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-10T23:28:14.390 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-10T23:28:14.390 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-09-10T23:28:14.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:14.421 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.0 M 2024-09-10T23:28:14.421 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 9.2 M 2024-09-10T23:28:14.421 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-10T23:28:14.794 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): nvmetcli-0.7-3.el9.noarch.rpm 388 kB/s | 44 kB 00:00 2024-09-10T23:28:14.827 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): libnvme-1.9-3.el9.x86_64.rpm 716 kB/s | 106 kB 00:00 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-configshell-1.1.30-1.el9.noarch. 962 kB/s | 72 kB 00:00 2024-09-10T23:28:14.903 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2024-09-10T23:28:14.936 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): nvme-cli-2.9.1-6.el9.x86_64.rpm 3.4 MB/s | 906 kB 00:00 2024-09-10T23:28:15.012 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 5.8 MB/s | 837 kB 00:00 2024-09-10T23:28:15.012 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:28:15.012 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.4 MB/s | 2.0 MB 00:00 2024-09-10T23:28:15.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:14 smithi046 ceph-mon[28128]: pgmap v1034: 129 pgs: 129 active+clean; 232 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2024-09-10T23:28:15.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:14 smithi073 ceph-mon[35473]: pgmap v1034: 129 pgs: 129 active+clean; 232 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2024-09-10T23:28:15.161 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-10T23:28:15.188 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-10T23:28:15.188 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-10T23:28:15.374 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-10T23:28:15.375 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-10T23:28:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T23:28:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-10T23:28:15.914 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-10T23:28:16.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2024-09-10T23:28:16.086 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/6 2024-09-10T23:28:16.130 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/6 2024-09-10T23:28:16.417 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/6 2024-09-10T23:28:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-10T23:28:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:16.417 INFO:teuthology.orchestra.run.smithi073.stdout:Removed: 2024-09-10T23:28:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T23:28:16.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:16.418 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T23:28:16.459 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T23:28:16.719 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:16 smithi073 ceph-mon[35473]: pgmap v1035: 129 pgs: 129 active+clean; 232 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 929 KiB/s wr, 103 op/s 2024-09-10T23:28:16.719 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:16 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:28:16.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:16 smithi046 ceph-mon[28128]: pgmap v1035: 129 pgs: 129 active+clean; 232 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 929 KiB/s wr, 103 op/s 2024-09-10T23:28:16.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:16 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:28:17.507 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:38:21 ago on Tue 10 Sep 2024 10:49:56 PM UTC. 2024-09-10T23:28:17.598 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T23:28:17.636 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T23:28:17.665 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T23:28:17.666 INFO:teuthology.orchestra.run.smithi073.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2024-09-10T23:28:17.667 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:17.694 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.0 M 2024-09-10T23:28:17.694 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 9.2 M 2024-09-10T23:28:17.694 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T23:28:17.755 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:17 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:17 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:18.071 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): nvmetcli-0.7-3.el9.noarch.rpm 358 kB/s | 44 kB 00:00 2024-09-10T23:28:18.121 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): nvme-cli-2.9.1-6.el9.x86_64.rpm 5.1 MB/s | 906 kB 00:00 2024-09-10T23:28:18.146 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): libnvme-1.9-3.el9.x86_64.rpm 530 kB/s | 106 kB 00:00 2024-09-10T23:28:18.171 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-configshell-1.1.30-1.el9.noarch. 715 kB/s | 72 kB 00:00 2024-09-10T23:28:18.196 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2024-09-10T23:28:18.280 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 6.1 MB/s | 837 kB 00:00 2024-09-10T23:28:18.281 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:28:18.281 INFO:teuthology.orchestra.run.smithi073.stdout:Total 3.4 MB/s | 2.0 MB 00:00 2024-09-10T23:28:18.423 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T23:28:18.448 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T23:28:18.448 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T23:28:18.619 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T23:28:18.619 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T23:28:18.944 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T23:28:18.944 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/6 2024-09-10T23:28:18.944 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/6 2024-09-10T23:28:18.944 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/6 2024-09-10T23:28:18.944 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/6 2024-09-10T23:28:18.944 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/6 2024-09-10T23:28:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:18 smithi046 ceph-mon[28128]: pgmap v1036: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.1 KiB/s rd, 717 KiB/s wr, 97 op/s 2024-09-10T23:28:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:18 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:18 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:19.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:18 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:28:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:18 smithi073 ceph-mon[35473]: pgmap v1036: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.1 KiB/s rd, 717 KiB/s wr, 97 op/s 2024-09-10T23:28:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:18 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:18 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:19.079 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:18 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' 2024-09-10T23:28:19.115 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T23:28:19.229 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-10T23:28:19.276 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-10T23:28:19.280 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/6 2024-09-10T23:28:19.315 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/6 2024-09-10T23:28:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/6 2024-09-10T23:28:19.603 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T23:28:19.684 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:20.647 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T23:28:20.700 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T23:28:20.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:20 smithi073 ceph-mon[35473]: pgmap v1037: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.1 KiB/s rd, 327 KiB/s wr, 78 op/s 2024-09-10T23:28:21.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:20 smithi046 ceph-mon[28128]: pgmap v1037: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.1 KiB/s rd, 327 KiB/s wr, 78 op/s 2024-09-10T23:28:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T23:28:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/6 2024-09-10T23:28:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/6 2024-09-10T23:28:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/6 2024-09-10T23:28:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/6 2024-09-10T23:28:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/6 2024-09-10T23:28:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2024-09-10T23:28:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:22.534 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T23:28:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T23:28:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-10T23:28:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-10T23:28:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T23:28:22.535 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T23:28:22.922 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:22 smithi073 ceph-mon[35473]: pgmap v1038: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.1 KiB/s rd, 285 KiB/s wr, 67 op/s 2024-09-10T23:28:22.925 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:22.925 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T23:28:22.935 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T23:28:22.936 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T23:28:22.936 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:22.998 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T23:28:22.998 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:23.073 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:22 smithi046 ceph-mon[28128]: pgmap v1038: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.1 KiB/s rd, 285 KiB/s wr, 67 op/s 2024-09-10T23:28:23.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:28:23.480 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:28:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 -- 172.21.15.46:0/2822761755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 msgr2=0x7fc52c10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 --2- 172.21.15.46:0/2822761755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c10c870 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc514009880 tx=0x7fc51402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 -- 172.21.15.46:0/2822761755 shutdown_connections 2024-09-10T23:28:24.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 --2- 172.21.15.46:0/2822761755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c10c870 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 --2- 172.21.15.46:0/2822761755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc52c103a60 0x7fc52c103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 -- 172.21.15.46:0/2822761755 >> 172.21.15.46:0/2822761755 conn(0x7fc52c0fd4e0 msgr2=0x7fc52c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 -- 172.21.15.46:0/2822761755 shutdown_connections 2024-09-10T23:28:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.450+0000 7fc533800640 1 -- 172.21.15.46:0/2822761755 wait complete. 2024-09-10T23:28:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.451+0000 7fc533800640 1 Processor -- start 2024-09-10T23:28:24.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.451+0000 7fc533800640 1 -- start start 2024-09-10T23:28:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc533800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc52c103a60 0x7fc52c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:24.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc533800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc533800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c10fb80 con 0x7fc52c104380 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc533800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c10fa00 con 0x7fc52c103a60 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc523e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc523e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33786/0 (socket says 172.21.15.46:33786) 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc523e00640 1 -- 172.21.15.46:0/2265453302 learned_addr learned my addr 172.21.15.46:0/2265453302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc530e00640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc52c103a60 0x7fc52c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc523e00640 1 -- 172.21.15.46:0/2265453302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc52c103a60 msgr2=0x7fc52c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc523e00640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc52c103a60 0x7fc52c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.452+0000 7fc523e00640 1 -- 172.21.15.46:0/2265453302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c19e140 con 0x7fc52c104380 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.453+0000 7fc523e00640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c198da0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc5140045e0 tx=0x7fc514004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.453+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc51403f070 con 0x7fc52c104380 2024-09-10T23:28:24.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.453+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc514004950 con 0x7fc52c104380 2024-09-10T23:28:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.453+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc514035030 con 0x7fc52c104380 2024-09-10T23:28:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.453+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52c19e3d0 con 0x7fc52c104380 2024-09-10T23:28:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.453+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52c19e900 con 0x7fc52c104380 2024-09-10T23:28:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.454+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc52c199520 con 0x7fc52c104380 2024-09-10T23:28:24.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.455+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7fc5140035f0 con 0x7fc52c104380 2024-09-10T23:28:24.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.456+0000 7fc52a000640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc51007a370 0x7fc51007c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:24.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.456+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7fc5140be330 con 0x7fc52c104380 2024-09-10T23:28:24.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.457+0000 7fc530e00640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc51007a370 0x7fc51007c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:24.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.457+0000 7fc530e00640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc51007a370 0x7fc51007c830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00abe0 tx=0x7fc51c00a2d0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:24.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.461+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc52c199520 con 0x7fc52c104380 2024-09-10T23:28:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.672+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc52c199990 con 0x7fc52c104380 2024-09-10T23:28:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.673+0000 7fc52a000640 1 -- 172.21.15.46:0/2265453302 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v65) ==== 81+0+1006 (secure 0 0 0) 0x7fc514085630 con 0x7fc52c104380 2024-09-10T23:28:24.674 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6833/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:28:24.674 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6832/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:28:24.674 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3052523989 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:24.674 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:24.674 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2163720030 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/220137103 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3240682838 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/263522480 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1989006756 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1231598076 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1514329312 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2623235150 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:listed 17 entries 2024-09-10T23:28:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc51007a370 msgr2=0x7fc51007c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc51007a370 0x7fc51007c830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00abe0 tx=0x7fc51c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 msgr2=0x7fc52c198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c198da0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc5140045e0 tx=0x7fc514004610 comp rx=0 tx=0).stop 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 shutdown_connections 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7fc51007a370 0x7fc51007c830 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc52c104380 0x7fc52c198da0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 --2- 172.21.15.46:0/2265453302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc52c103a60 0x7fc52c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 >> 172.21.15.46:0/2265453302 conn(0x7fc52c0fd4e0 msgr2=0x7fc52c107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 shutdown_connections 2024-09-10T23:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:24.675+0000 7fc533800640 1 -- 172.21.15.46:0/2265453302 wait complete. 2024-09-10T23:28:25.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:24 smithi046 ceph-mon[28128]: pgmap v1039: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 170 B/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-10T23:28:25.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:24 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/2265453302' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:28:25.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:24 smithi073 ceph-mon[35473]: pgmap v1039: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 170 B/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-10T23:28:25.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:24 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/2265453302' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:28:25.484 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T23:28:25.484 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:25.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:28:25.912 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/mon.smithi046/config 2024-09-10T23:28:26.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 -- 172.21.15.46:0/1698834684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0102b60 msgr2=0x7f85d0102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1698834684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0102b60 0x7f85d0102f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009880 tx=0x7f85c002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 -- 172.21.15.46:0/1698834684 shutdown_connections 2024-09-10T23:28:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1698834684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0108570 0x7f85d01089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1698834684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0102b60 0x7f85d0102f40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 -- 172.21.15.46:0/1698834684 >> 172.21.15.46:0/1698834684 conn(0x7f85d00fe5b0 msgr2=0x7f85d01009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.427+0000 7f85d4c00640 1 -- 172.21.15.46:0/1698834684 shutdown_connections 2024-09-10T23:28:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.428+0000 7f85d4c00640 1 -- 172.21.15.46:0/1698834684 wait complete. 2024-09-10T23:28:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.428+0000 7f85d4c00640 1 Processor -- start 2024-09-10T23:28:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85d4c00640 1 -- start start 2024-09-10T23:28:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85d4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0102b60 0x7f85d01987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85d4c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 0x7f85d0198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85d4c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010fb90 con 0x7f85d0108570 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85d4c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010fa10 con 0x7f85d0102b60 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85c7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 0x7f85d0198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85c7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 0x7f85d0198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33800/0 (socket says 172.21.15.46:33800) 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.429+0000 7f85c7e00640 1 -- 172.21.15.46:0/1010778041 learned_addr learned my addr 172.21.15.46:0/1010778041 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85cde00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0102b60 0x7f85d01987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c7e00640 1 -- 172.21.15.46:0/1010778041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0102b60 msgr2=0x7f85d01987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c7e00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0102b60 0x7f85d01987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c7e00640 1 -- 172.21.15.46:0/1010778041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d019e0b0 con 0x7f85d0108570 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85cde00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0102b60 0x7f85d01987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c7e00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 0x7f85d0198d10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f85b800d8d0 tx=0x7f85b800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85b8017070 con 0x7f85d0108570 2024-09-10T23:28:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85b8010460 con 0x7f85d0108570 2024-09-10T23:28:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85b800f5f0 con 0x7f85d0108570 2024-09-10T23:28:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.430+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d019e3a0 con 0x7f85d0108570 2024-09-10T23:28:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.431+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d019e930 con 0x7f85d0108570 2024-09-10T23:28:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.432+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d0199490 con 0x7f85d0108570 2024-09-10T23:28:26.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.433+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 102480+0+0 (secure 0 0 0) 0x7f85b8010930 con 0x7f85d0108570 2024-09-10T23:28:26.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.434+0000 7f85c6a00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f85b407a370 0x7f85b407c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.434+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7340+0+0 (secure 0 0 0) 0x7f85b809d3a0 con 0x7f85d0108570 2024-09-10T23:28:26.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.435+0000 7f85cde00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f85b407a370 0x7f85b407c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.435+0000 7f85cde00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f85b407a370 0x7f85b407c830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85c0005ab0 tx=0x7f85c00041a0 comp rx=0 tx=0).ready entity=mgr.14227 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:26.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.438+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85d0199490 con 0x7f85d0108570 2024-09-10T23:28:26.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.649+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f85d010ad10 con 0x7f85d0108570 2024-09-10T23:28:26.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.650+0000 7f85c6a00640 1 -- 172.21.15.46:0/1010778041 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v65) ==== 81+0+1006 (secure 0 0 0) 0x7f85b80646a0 con 0x7f85d0108570 2024-09-10T23:28:26.650 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6833/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.73:6832/2343722155 2024-09-11T23:02:34.901153+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3052523989 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2163720030 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/220137103 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3240682838 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/263522480 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1989006756 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1963998222 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/584006451 2024-09-11T22:53:39.482819+0000 2024-09-10T23:28:26.651 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1231598076 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:26.652 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/4066155340 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:26.652 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1514329312 2024-09-11T22:54:15.921880+0000 2024-09-10T23:28:26.652 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2623235150 2024-09-11T22:55:30.890832+0000 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:listed 17 entries 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f85b407a370 msgr2=0x7f85b407c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f85b407a370 0x7f85b407c830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85c0005ab0 tx=0x7f85c00041a0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 msgr2=0x7f85d0198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 0x7f85d0198d10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f85b800d8d0 tx=0x7f85b800dd90 comp rx=0 tx=0).stop 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 shutdown_connections 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:6800/3534556395,v1:172.21.15.46:6801/3534556395] conn(0x7f85b407a370 0x7f85b407c830 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85d0108570 0x7f85d0198d10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 --2- 172.21.15.46:0/1010778041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d0102b60 0x7f85d01987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.652+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 >> 172.21.15.46:0/1010778041 conn(0x7f85d00fe5b0 msgr2=0x7f85d00ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.653+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 shutdown_connections 2024-09-10T23:28:26.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-10T23:28:26.653+0000 7f85d4c00640 1 -- 172.21.15.46:0/1010778041 wait complete. 2024-09-10T23:28:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:26 smithi046 ceph-mon[28128]: pgmap v1040: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 170 B/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-10T23:28:27.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:26 smithi046 ceph-mon[28128]: from='client.? 172.21.15.46:0/1010778041' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:28:27.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:26 smithi073 ceph-mon[35473]: pgmap v1040: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 170 B/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-10T23:28:27.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:26 smithi073 ceph-mon[35473]: from='client.? 172.21.15.46:0/1010778041' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:28:27.446 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-10T23:28:27.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:27.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T23:28:27.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:28:27.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[64759]: fuse finished with error 0 and tester_r 0 2024-09-10T23:28:29.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:28 smithi046 ceph-mon[28128]: pgmap v1041: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.6 KiB/s wr, 1 op/s 2024-09-10T23:28:29.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:28 smithi073 ceph-mon[35473]: pgmap v1041: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.6 KiB/s wr, 1 op/s 2024-09-10T23:28:31.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:30 smithi046 ceph-mon[28128]: pgmap v1042: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-10T23:28:31.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:30 smithi073 ceph-mon[35473]: pgmap v1042: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-10T23:28:32.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:31 smithi046 ceph-mon[28128]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:28:32.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:31 smithi073 ceph-mon[35473]: from='mgr.14227 172.21.15.46:0/1851944111' entity='mgr.smithi046.eocvws' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T23:28:33.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:32 smithi046 ceph-mon[28128]: pgmap v1043: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 938 B/s wr, 0 op/s 2024-09-10T23:28:33.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:32 smithi073 ceph-mon[35473]: pgmap v1043: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 938 B/s wr, 0 op/s 2024-09-10T23:28:33.626 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T23:28:33.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:33.627 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:28:33.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:33.687 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-10T23:28:33.728 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:28:33.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:33.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:28:33.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:33.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-10T23:28:34.188 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T23:28:34.198 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T23:28:34.199 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-10T23:28:34.199 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:34.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053403,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/5615a60e3be43a58df7937fda8c8354b267980629281abb72271ca10b422f994/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/5615a60e3be43a58df7937fda8c8354b267980629281abb72271ca10b422f994/diff,workdir=/var/lib/containers/storage/overlay/5615a60e3be43a58df7937fda8c8354b267980629281abb72271ca10b422f994/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9f8d441a2a8c668e57783208467192d999698e1bdfa231276171324a3fef265b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/9f8d441a2a8c668e57783208467192d999698e1bdfa231276171324a3fef265b/diff,workdir=/var/lib/containers/storage/overlay/9f8d441a2a8c668e57783208467192d999698e1bdfa231276171324a3fef265b/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/bad6610ad8484fadc985eea6a7aa4a3e19e26a71c9b3a56f48ba4c97bd3f84fb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/bad6610ad8484fadc985eea6a7aa4a3e19e26a71c9b3a56f48ba4c97bd3f84fb/diff,workdir=/var/lib/containers/storage/overlay/bad6610ad8484fadc985eea6a7aa4a3e19e26a71c9b3a56f48ba4c97bd3f84fb/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/00d8ceb7e1d6b20d111145187efe56d1972f3fb4414dc90350bef6eba5dccd32/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/00d8ceb7e1d6b20d111145187efe56d1972f3fb4414dc90350bef6eba5dccd32/diff,workdir=/var/lib/containers/storage/overlay/00d8ceb7e1d6b20d111145187efe56d1972f3fb4414dc90350bef6eba5dccd32/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3c8869db846776e165e05cd606883c403fb5378be580b20a2a9cabbcccd1e2f4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VX6N2BX7OVEGNOG26FBOZE2ZZL:/var/lib/containers/storage/overlay/l/I6OYCY5IPLH2W6OO2S7XN6ERGS:/var/lib/containers/storage/overlay/l/S4WFTPHO5XJH42IBOVU5VXH7PV,upperdir=/var/lib/containers/storage/overlay/3c8869db846776e165e05cd606883c403fb5378be580b20a2a9cabbcccd1e2f4/diff,workdir=/var/lib/containers/storage/overlay/3c8869db846776e165e05cd606883c403fb5378be580b20a2a9cabbcccd1e2f4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/082275dc7f9dfecdd81de790ad8bc6c4adb10af6a6fa97dfdcb0c11fbe7120c9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RE2XMA2QKKOTGMFVTPREC2LNXU:/var/lib/containers/storage/overlay/l/NNAPWWUXIDNNX4IXYPLFTMFNGO:/var/lib/containers/storage/overlay/l/57PFZEG7WZTAQMBTERUNQCSXHD:/var/lib/containers/storage/overlay/l/IPXNZMQM2HHM6OD3RIS2OUOM56:/var/lib/containers/storage/overlay/l/G4GI6WWKC73TYNR4PLBIPZ2ZTC:/var/lib/containers/storage/overlay/l/WKXXNMA5RZX7IOES3IBMPVGVNH:/var/lib/containers/storage/overlay/l/7MB75RSBAJYAHQALKJRSIOREGX,upperdir=/var/lib/containers/storage/overlay/082275dc7f9dfecdd81de790ad8bc6c4adb10af6a6fa97dfdcb0c11fbe7120c9/diff,workdir=/var/lib/containers/storage/overlay/082275dc7f9dfecdd81de790ad8bc6c4adb10af6a6fa97dfdcb0c11fbe7120c9/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9ed58acc35802394ef299f5ef82e78a59c6785cdbe6f0841202bf079cff26fdc/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y6ECT2ARL6BEOLNZF6NPTAPXYF:/var/lib/containers/storage/overlay/l/R5E4SN6UBLOZKUDTGIRWKF2GM6:/var/lib/containers/storage/overlay/l/RQRTN3LA5KOKSR26RMQ464MM4P:/var/lib/containers/storage/overlay/l/6T2L6FIOLDWYNW32PNWDPSRDE2:/var/lib/containers/storage/overlay/l/YHEPUJIQQU34O6MW2USCW35KAQ:/var/lib/containers/storage/overlay/l/J7W6ZF545UTM4OJZ5YZZNTKCON:/var/lib/containers/storage/overlay/l/F74Z3HU4K7OGN2UXKPECRPH5GJ:/var/lib/containers/storage/overlay/l/BCHGEVUW3CNJ34WVLAZXSPUG2G:/var/lib/containers/storage/overlay/l/YAPE2CSZGOMNQCH6QK2VL7RNOV:/var/lib/containers/storage/overlay/l/3XXXQ2KLD7ODBG5ZOL3BLTQ46X,upperdir=/var/lib/containers/storage/overlay/9ed58acc35802394ef299f5ef82e78a59c6785cdbe6f0841202bf079cff26fdc/diff,workdir=/var/lib/containers/storage/overlay/9ed58acc35802394ef299f5ef82e78a59c6785cdbe6f0841202bf079cff26fdc/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5980231983e55f949f015201811f5bf7c0b2b4998a2cbe5671612c3066595930/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/5TE2Y76T7IBPIYF34TWWG3K5QU:/var/lib/containers/storage/overlay/l/E6IMCCAGEBGB4NUJJDLLZJSXFM:/var/lib/containers/storage/overlay/l/3GR325IHRO6HAQO5DBTLTRZ36S:/var/lib/containers/storage/overlay/l/LPZKHK3DSPFEXKTAXFUY6USRG7:/var/lib/containers/storage/overlay/l/DAYGEXXWT5YXQULQ2L23XS6D2Z:/var/lib/containers/storage/overlay/l/72PFTOB2W7VRM4ELFXJDMZBUOM:/var/lib/containers/storage/overlay/l/7W3DSWVASNF3DNZWRFBKHRSXPP:/var/lib/containers/storage/overlay/l/YNML73SAYFNCHTTL6HMU2NWTZF:/var/lib/containers/storage/overlay/l/TPQ3KG2LMMYGSEBJ45VUNALW6Y:/var/lib/containers/storage/overlay/l/K37LVYHX7NEUOFDM7EIAF6DPFS:/var/lib/containers/storage/overlay/l/WKXXNMA5RZX7IOES3IBMPVGVNH:/var/lib/containers/storage/overlay/l/7MB75RSBAJYAHQALKJRSIOREGX,upperdir=/var/lib/containers/storage/overlay/5980231983e55f949f015201811f5bf7c0b2b4998a2cbe5671612c3066595930/diff,workdir=/var/lib/containers/storage/overlay/5980231983e55f949f015201811f5bf7c0b2b4998a2cbe5671612c3066595930/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/08eddbff9a07f168de89f81ffe4cdf76421d4e5191bdbb8ef82566a08446ff48/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/08eddbff9a07f168de89f81ffe4cdf76421d4e5191bdbb8ef82566a08446ff48/diff,workdir=/var/lib/containers/storage/overlay/08eddbff9a07f168de89f81ffe4cdf76421d4e5191bdbb8ef82566a08446ff48/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b61dae2809268912a99d8dcccc178d1d7ea2391d5197a71df5ff367bb92c6a75/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/b61dae2809268912a99d8dcccc178d1d7ea2391d5197a71df5ff367bb92c6a75/diff,workdir=/var/lib/containers/storage/overlay/b61dae2809268912a99d8dcccc178d1d7ea2391d5197a71df5ff367bb92c6a75/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/402bc66370543f66a59811e29b7e08139c46d6f9f18c98f67db31ace455094bf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/402bc66370543f66a59811e29b7e08139c46d6f9f18c98f67db31ace455094bf/diff,workdir=/var/lib/containers/storage/overlay/402bc66370543f66a59811e29b7e08139c46d6f9f18c98f67db31ace455094bf/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c11f928a750afcdeb4da35962eedf5be3d284c1bd5b05674b69e38128e29a19c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/c11f928a750afcdeb4da35962eedf5be3d284c1bd5b05674b69e38128e29a19c/diff,workdir=/var/lib/containers/storage/overlay/c11f928a750afcdeb4da35962eedf5be3d284c1bd5b05674b69e38128e29a19c/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0cfa3d13e69860610d25738aff7c5555ea458c8db8dcc1528aef3df6abfaa5e7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/0cfa3d13e69860610d25738aff7c5555ea458c8db8dcc1528aef3df6abfaa5e7/diff,workdir=/var/lib/containers/storage/overlay/0cfa3d13e69860610d25738aff7c5555ea458c8db8dcc1528aef3df6abfaa5e7/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2a956f8a604d897be7a99ea2e04610d63606ac423e96f65b8a55ad0b798d837e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/E3ELIIST3QULWU4UPCCU35TNRN:/var/lib/containers/storage/overlay/l/4D5SANSDQNHLU3PPNLOOOQZXX2,upperdir=/var/lib/containers/storage/overlay/2a956f8a604d897be7a99ea2e04610d63606ac423e96f65b8a55ad0b798d837e/diff,workdir=/var/lib/containers/storage/overlay/2a956f8a604d897be7a99ea2e04610d63606ac423e96f65b8a55ad0b798d837e/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-09-10T23:28:34.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:34.243 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-10T23:28:34.319 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:28:34.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:34.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:28:34.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:34.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-10T23:28:34.776 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T23:28:34.785 INFO:tasks.cephadm:Teardown begin 2024-09-10T23:28:34.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:28:34.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:28:34.903 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T23:28:34.904 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:28:34.939 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:28:34.974 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T23:28:34.975 INFO:tasks.cephadm.mon.smithi046:Stopping mon.smithi046... 2024-09-10T23:28:34.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046 2024-09-10T23:28:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:34 smithi046 ceph-mon[28128]: pgmap v1044: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:28:35.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:35 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:28:35.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:34 smithi073 ceph-mon[35473]: pgmap v1044: 129 pgs: 129 active+clean; 228 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T23:28:35.726 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:35 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046[28124]: 2024-09-10T23:28:35.390+0000 7f464c400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:28:35.726 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:35 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046[28124]: 2024-09-10T23:28:35.391+0000 7f464c400640 -1 mon.smithi046@0(leader) e2 *** Got Signal Terminated *** 2024-09-10T23:28:35.726 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:35 smithi046 podman[89870]: 2024-09-10 23:28:35.565069215 +0000 UTC m=+0.299507345 container died dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:28:36.265 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:36 smithi046 podman[89870]: 2024-09-10 23:28:36.0121878 +0000 UTC m=+0.746625930 container cleanup dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T23:28:36.265 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:36 smithi046 bash[89870]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046 2024-09-10T23:28:36.554 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 10 23:28:36 smithi046 podman[89881]: 2024-09-10 23:28:36.297559343 +0000 UTC m=+0.722804204 container remove dff327a0adc68c869e2b359b3771bf0a1bb31142e1ed29d7217fd9d113aa80e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi046, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:28:36.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi046.service' 2024-09-10T23:28:36.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:28:36.703 INFO:tasks.cephadm.mon.smithi046:Stopped mon.smithi046 2024-09-10T23:28:36.703 INFO:tasks.cephadm.mon.smithi073:Stopping mon.smithi073... 2024-09-10T23:28:36.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi073 2024-09-10T23:28:37.080 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:36 smithi073 systemd[1]: Stopping Ceph mon.smithi073 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:28:37.579 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:37 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073[35469]: 2024-09-10T23:28:37.208+0000 7f594c600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi073 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:28:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:37 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073[35469]: 2024-09-10T23:28:37.208+0000 7f594c600640 -1 mon.smithi073@1(peon) e2 *** Got Signal Terminated *** 2024-09-10T23:28:37.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:37 smithi073 podman[73237]: 2024-09-10 23:28:37.389170988 +0000 UTC m=+0.340776346 container died 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T23:28:37.995 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:37 smithi073 podman[73237]: 2024-09-10 23:28:37.97459093 +0000 UTC m=+0.926196287 container cleanup 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T23:28:37.995 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:37 smithi073 bash[73237]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073 2024-09-10T23:28:38.511 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Sep 10 23:28:38 smithi073 podman[73249]: 2024-09-10 23:28:38.243705047 +0000 UTC m=+0.844244225 container remove 670ecdcdbc733b85b512417bb7edbee62c9a29b420f0c37e58a2710442e46f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-mon-smithi073, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:28:38.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@mon.smithi073.service' 2024-09-10T23:28:38.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:28:38.620 INFO:tasks.cephadm.mon.smithi073:Stopped mon.smithi073 2024-09-10T23:28:38.620 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T23:28:38.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.0 2024-09-10T23:28:39.038 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:38 smithi046 systemd[1]: Stopping Ceph osd.0 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:28:39.323 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:39 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0[49431]: 2024-09-10T23:28:39.037+0000 7f5334000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:28:39.323 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:39 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0[49431]: 2024-09-10T23:28:39.037+0000 7f5334000640 -1 osd.0 65 *** Got signal Terminated *** 2024-09-10T23:28:39.323 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:39 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0[49431]: 2024-09-10T23:28:39.037+0000 7f5334000640 -1 osd.0 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:28:44.948 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:44 smithi046 podman[90006]: 2024-09-10 23:28:44.649109944 +0000 UTC m=+5.729710054 container died 4c6c1e0e2d529908be0ec1700cdd187ef1de48dfae7c996bd0d5c69c38432e59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T23:28:45.323 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:45 smithi046 podman[90006]: 2024-09-10 23:28:45.109378904 +0000 UTC m=+6.189979013 container cleanup 4c6c1e0e2d529908be0ec1700cdd187ef1de48dfae7c996bd0d5c69c38432e59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:28:45.323 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:45 smithi046 bash[90006]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0 2024-09-10T23:28:45.823 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:45 smithi046 podman[90024]: 2024-09-10 23:28:45.327565932 +0000 UTC m=+0.667083284 container remove 4c6c1e0e2d529908be0ec1700cdd187ef1de48dfae7c996bd0d5c69c38432e59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T23:28:46.156 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:45 smithi046 podman[90118]: 2024-09-10 23:28:45.780725826 +0000 UTC m=+0.027985383 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:28:46.156 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:45 smithi046 podman[90118]: 2024-09-10 23:28:45.903315658 +0000 UTC m=+0.150575204 container create 77cddaae29debccde66b5c0eee1f47345dd78fe9aedb3828193c4d6fcb59a0e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T23:28:46.157 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:46 smithi046 podman[90118]: 2024-09-10 23:28:46.156290461 +0000 UTC m=+0.403550008 container init 77cddaae29debccde66b5c0eee1f47345dd78fe9aedb3828193c4d6fcb59a0e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T23:28:46.573 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:46 smithi046 podman[90118]: 2024-09-10 23:28:46.164393853 +0000 UTC m=+0.411653411 container start 77cddaae29debccde66b5c0eee1f47345dd78fe9aedb3828193c4d6fcb59a0e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:28:46.573 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:46 smithi046 podman[90118]: 2024-09-10 23:28:46.247559154 +0000 UTC m=+0.494818725 container attach 77cddaae29debccde66b5c0eee1f47345dd78fe9aedb3828193c4d6fcb59a0e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T23:28:46.952 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 10 23:28:46 smithi046 podman[90141]: 2024-09-10 23:28:46.663561943 +0000 UTC m=+0.026901722 container died 77cddaae29debccde66b5c0eee1f47345dd78fe9aedb3828193c4d6fcb59a0e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T23:28:47.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T23:28:47.389 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:28:47.389 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T23:28:47.389 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T23:28:47.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.1 2024-09-10T23:28:47.573 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:47 smithi046 systemd[1]: Stopping Ceph osd.1 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:28:48.323 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:47 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1[56796]: 2024-09-10T23:28:47.841+0000 7f4539c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:28:48.323 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:47 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1[56796]: 2024-09-10T23:28:47.841+0000 7f4539c00640 -1 osd.1 65 *** Got signal Terminated *** 2024-09-10T23:28:48.323 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:47 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1[56796]: 2024-09-10T23:28:47.841+0000 7f4539c00640 -1 osd.1 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:28:53.763 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:53 smithi046 podman[90220]: 2024-09-10 23:28:53.428796596 +0000 UTC m=+5.747536133 container died 6c1e82951273e229667ee9c0534ff98137bdd50445c416dabfc9ecfa2e754017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:28:54.064 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:53 smithi046 podman[90220]: 2024-09-10 23:28:53.879624036 +0000 UTC m=+6.198363572 container cleanup 6c1e82951273e229667ee9c0534ff98137bdd50445c416dabfc9ecfa2e754017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T23:28:54.064 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:53 smithi046 bash[90220]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1 2024-09-10T23:28:54.323 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:54 smithi046 podman[90250]: 2024-09-10 23:28:54.064156155 +0000 UTC m=+0.628331457 container remove 6c1e82951273e229667ee9c0534ff98137bdd50445c416dabfc9ecfa2e754017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T23:28:54.824 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:54 smithi046 podman[90336]: 2024-09-10 23:28:54.507912617 +0000 UTC m=+0.028008447 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:28:54.824 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:54 smithi046 podman[90336]: 2024-09-10 23:28:54.648658658 +0000 UTC m=+0.168754487 container create cad6320c675a0412fd96e46ed9919b4cb32127f3b463c3cd76d84e75a78739f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T23:28:55.238 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:54 smithi046 podman[90336]: 2024-09-10 23:28:54.968169371 +0000 UTC m=+0.488265223 container init cad6320c675a0412fd96e46ed9919b4cb32127f3b463c3cd76d84e75a78739f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:28:55.239 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:54 smithi046 podman[90336]: 2024-09-10 23:28:54.975131236 +0000 UTC m=+0.495227074 container start cad6320c675a0412fd96e46ed9919b4cb32127f3b463c3cd76d84e75a78739f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T23:28:55.239 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:55 smithi046 podman[90336]: 2024-09-10 23:28:55.067692974 +0000 UTC m=+0.587788808 container attach cad6320c675a0412fd96e46ed9919b4cb32127f3b463c3cd76d84e75a78739f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:28:55.573 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 10 23:28:55 smithi046 podman[90336]: 2024-09-10 23:28:55.238542682 +0000 UTC m=+0.758638523 container died cad6320c675a0412fd96e46ed9919b4cb32127f3b463c3cd76d84e75a78739f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T23:28:55.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T23:28:56.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:28:56.056 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T23:28:56.056 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T23:28:56.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.2 2024-09-10T23:28:56.323 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:28:56 smithi046 systemd[1]: Stopping Ceph osd.2 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:28:56.823 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:28:56 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2[63618]: 2024-09-10T23:28:56.452+0000 7f8b56400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:28:56.823 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:28:56 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2[63618]: 2024-09-10T23:28:56.452+0000 7f8b56400640 -1 osd.2 65 *** Got signal Terminated *** 2024-09-10T23:28:56.823 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:28:56 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2[63618]: 2024-09-10T23:28:56.452+0000 7f8b56400640 -1 osd.2 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:29:02.194 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:01 smithi046 podman[90439]: 2024-09-10 23:29:01.876772738 +0000 UTC m=+5.529409670 container died ba009426794ec0fa863bbff0d04440afed920df536967013e141a5c6b9df5c36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:29:02.567 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:02 smithi046 podman[90439]: 2024-09-10 23:29:02.316128908 +0000 UTC m=+5.968765845 container cleanup ba009426794ec0fa863bbff0d04440afed920df536967013e141a5c6b9df5c36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:29:02.567 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:02 smithi046 bash[90439]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2 2024-09-10T23:29:02.823 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:02 smithi046 podman[90457]: 2024-09-10 23:29:02.567439189 +0000 UTC m=+0.667645297 container remove ba009426794ec0fa863bbff0d04440afed920df536967013e141a5c6b9df5c36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:29:03.412 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:03 smithi046 podman[90547]: 2024-09-10 23:29:03.029472023 +0000 UTC m=+0.028415451 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:29:03.413 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:03 smithi046 podman[90547]: 2024-09-10 23:29:03.13484925 +0000 UTC m=+0.133792668 container create e4605491a3c92b05a9ea7d512a86c9552d18946c7978fe2242880c848a85edb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-10T23:29:03.413 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:03 smithi046 podman[90547]: 2024-09-10 23:29:03.41261602 +0000 UTC m=+0.411559448 container init e4605491a3c92b05a9ea7d512a86c9552d18946c7978fe2242880c848a85edb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T23:29:03.682 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:03 smithi046 podman[90547]: 2024-09-10 23:29:03.421618618 +0000 UTC m=+0.420562036 container start e4605491a3c92b05a9ea7d512a86c9552d18946c7978fe2242880c848a85edb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T23:29:03.682 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:03 smithi046 podman[90547]: 2024-09-10 23:29:03.504048947 +0000 UTC m=+0.502992375 container attach e4605491a3c92b05a9ea7d512a86c9552d18946c7978fe2242880c848a85edb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:29:04.007 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 10 23:29:03 smithi046 podman[90547]: 2024-09-10 23:29:03.682714041 +0000 UTC m=+0.681657460 container died e4605491a3c92b05a9ea7d512a86c9552d18946c7978fe2242880c848a85edb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T23:29:04.390 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T23:29:04.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:29:04.470 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T23:29:04.470 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T23:29:04.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.3 2024-09-10T23:29:04.609 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:04 smithi046 systemd[1]: Stopping Ceph osd.3 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:29:05.323 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:04 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T23:29:04.880+0000 7fb232800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:29:05.323 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:04 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T23:29:04.880+0000 7fb232800640 -1 osd.3 65 *** Got signal Terminated *** 2024-09-10T23:29:05.323 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:04 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T23:29:04.880+0000 7fb232800640 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:29:05.329 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:05 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:05.145+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:05.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:05 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:05.037+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:06.329 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:06 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:06.128+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:06.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:06 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:06.001+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:07.329 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:07.103+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:07.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:07.010+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:07.823 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:07 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T23:29:07.568+0000 7fb229200640 -1 osd.3 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:38.233568+0000 front 2024-09-10T23:28:38.233613+0000 (oldest deadline 2024-09-10T23:29:07.034313+0000) 2024-09-10T23:29:07.831 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:07.576+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:07.832 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:07.522+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:08.329 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:08 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:08.085+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:08.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:07 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:07.962+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:08.823 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:08 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T23:29:08.546+0000 7fb229200640 -1 osd.3 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:38.233568+0000 front 2024-09-10T23:28:38.233613+0000 (oldest deadline 2024-09-10T23:29:07.034313+0000) 2024-09-10T23:29:08.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:08 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:08.474+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:08.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:08 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:08.609+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:09.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:09 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:09.050+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:09.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:08 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:08.953+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:09.823 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:09 smithi046 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3[70136]: 2024-09-10T23:29:09.526+0000 7fb229200640 -1 osd.3 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:38.233568+0000 front 2024-09-10T23:28:38.233613+0000 (oldest deadline 2024-09-10T23:29:07.034313+0000) 2024-09-10T23:29:09.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:09 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:09.437+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:09.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:09 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:09.601+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:10.329 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:10 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:10.071+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:10.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:09 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:09.969+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:10.573 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:10 smithi046 podman[90648]: 2024-09-10 23:29:10.325767912 +0000 UTC m=+5.571848413 container stop 6c73fc2bb8dc7dde53704d1b25a82eb57880978f6103afbd1648eb3bfad574d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T23:29:10.573 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:10 smithi046 podman[90648]: 2024-09-10 23:29:10.351659702 +0000 UTC m=+5.597740203 container died 6c73fc2bb8dc7dde53704d1b25a82eb57880978f6103afbd1648eb3bfad574d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T23:29:10.829 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:10 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:10.467+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:10.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:10 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:10.614+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:11.037 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:10 smithi046 podman[90648]: 2024-09-10 23:29:10.752508288 +0000 UTC m=+5.998588788 container cleanup 6c73fc2bb8dc7dde53704d1b25a82eb57880978f6103afbd1648eb3bfad574d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:29:11.037 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:10 smithi046 bash[90648]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3 2024-09-10T23:29:11.323 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:11 smithi046 podman[90665]: 2024-09-10 23:29:11.037191391 +0000 UTC m=+0.697660064 container remove 6c73fc2bb8dc7dde53704d1b25a82eb57880978f6103afbd1648eb3bfad574d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T23:29:11.329 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:11 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:11.099+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:11.329 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:10 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:10.992+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:11.581 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:11 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:11.443+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:11.833 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:11 smithi046 podman[90750]: 2024-09-10 23:29:11.481005734 +0000 UTC m=+0.028245733 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:29:11.833 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:11 smithi046 podman[90750]: 2024-09-10 23:29:11.59657681 +0000 UTC m=+0.143816806 container create 5711791cd42b31a6e403b0c8568ad16eb2846f7fc5039f2a77dac4a05390a277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T23:29:11.833 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:11 smithi046 podman[90750]: 2024-09-10 23:29:11.832516826 +0000 UTC m=+0.379756826 container init 5711791cd42b31a6e403b0c8568ad16eb2846f7fc5039f2a77dac4a05390a277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-10T23:29:11.993 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:11 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:11.580+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:12.108 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:11 smithi046 podman[90750]: 2024-09-10 23:29:11.839654063 +0000 UTC m=+0.386894066 container start 5711791cd42b31a6e403b0c8568ad16eb2846f7fc5039f2a77dac4a05390a277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-10T23:29:12.109 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:11 smithi046 podman[90750]: 2024-09-10 23:29:11.923576081 +0000 UTC m=+0.470816093 container attach 5711791cd42b31a6e403b0c8568ad16eb2846f7fc5039f2a77dac4a05390a277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T23:29:12.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:11 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:11.992+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:12.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:12 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:12.114+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:12.435 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 10 23:29:12 smithi046 podman[90750]: 2024-09-10 23:29:12.108750346 +0000 UTC m=+0.655990356 container died 5711791cd42b31a6e403b0c8568ad16eb2846f7fc5039f2a77dac4a05390a277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T23:29:12.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T23:29:12.829 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:12 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:12.470+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:12.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:12 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:12.626+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:12.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:29:12.902 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T23:29:12.902 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T23:29:12.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.4 2024-09-10T23:29:13.329 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:12 smithi073 systemd[1]: Stopping Ceph osd.4 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:29:13.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:13.008+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:13.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:13.151+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:13.634 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:13.338+0000 7f01b1200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:29:13.634 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:13.338+0000 7f01b1200640 -1 osd.4 65 *** Got signal Terminated *** 2024-09-10T23:29:13.634 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:13.338+0000 7f01b1200640 -1 osd.4 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:29:13.634 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:13.503+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:13.960 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:13.633+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:14.329 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:13 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:13.959+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:14.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:14.159+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:14.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:14.159+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:14.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:14.509+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:14.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:14.655+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:14.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:14.655+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:15.329 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:14.991+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:15.329 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:14 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:14.991+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:15.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:15.116+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:15.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:15.116+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:15.829 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:15.512+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:15.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:15.636+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:15.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:15.636+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:16.329 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:15.967+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:16.329 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:15 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:15.967+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:16.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:16 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:16.104+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:16.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:16 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:16.104+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:16.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:16 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:16.681+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:16.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:16 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:16.681+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:16.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:16 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:16.520+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:16.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:16 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:16.520+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.858440+0000 front 2024-09-10T23:28:50.858414+0000 (oldest deadline 2024-09-10T23:29:16.158599+0000) 2024-09-10T23:29:17.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:16.999+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:17.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:16.999+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:17.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:17.078+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:17.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:17.078+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:17.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:17.700+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:17.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:17.700+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:17.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:17.471+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.955806+0000 front 2024-09-10T23:28:43.955593+0000 (oldest deadline 2024-09-10T23:29:07.356855+0000) 2024-09-10T23:29:17.830 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4[41091]: 2024-09-10T23:29:17.471+0000 7f01a7c00640 -1 osd.4 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.858440+0000 front 2024-09-10T23:28:50.858414+0000 (oldest deadline 2024-09-10T23:29:16.158599+0000) 2024-09-10T23:29:18.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:17.952+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:18.330 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:17 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:17.952+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:18.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:18 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:18.096+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:18.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:18 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:18.096+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:18.974 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:18 smithi073 podman[73362]: 2024-09-10 23:29:18.887788817 +0000 UTC m=+5.696772168 container died 29c4185ca49a3f9eb26501ca71b26ab1d362fe77d2651a52d1c22fad1c49fbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:29:18.975 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:18 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:18.671+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:18.975 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:18 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:18.671+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:19.227 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:19 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:19.087+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:19.227 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:19 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:19.087+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:19.227 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:18 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:18.973+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:19.227 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:18 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:18.973+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:19.579 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:19 smithi073 podman[73362]: 2024-09-10 23:29:19.320708593 +0000 UTC m=+6.129691943 container cleanup 29c4185ca49a3f9eb26501ca71b26ab1d362fe77d2651a52d1c22fad1c49fbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:29:19.580 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:19 smithi073 bash[73362]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4 2024-09-10T23:29:19.998 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:19 smithi073 podman[73378]: 2024-09-10 23:29:19.580401639 +0000 UTC m=+0.671539453 container remove 29c4185ca49a3f9eb26501ca71b26ab1d362fe77d2651a52d1c22fad1c49fbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T23:29:19.998 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:19 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:19.639+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:19.998 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:19 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:19.639+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:20.294 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:19 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:19.996+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:20.295 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:19 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:19.996+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:20.295 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:20 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:20.112+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:20.295 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:20 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:20.112+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:20.295 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:20 smithi073 podman[73467]: 2024-09-10 23:29:20.028119806 +0000 UTC m=+0.026808825 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:29:20.295 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:20 smithi073 podman[73467]: 2024-09-10 23:29:20.165050335 +0000 UTC m=+0.163739332 container create e13a4e882c6107ada8633d6b9ad94f8b50018c045a13f5ae771317cc52c50aad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T23:29:20.579 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:20 smithi073 podman[73467]: 2024-09-10 23:29:20.409249154 +0000 UTC m=+0.407938171 container init e13a4e882c6107ada8633d6b9ad94f8b50018c045a13f5ae771317cc52c50aad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:29:20.580 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:20 smithi073 podman[73467]: 2024-09-10 23:29:20.416402454 +0000 UTC m=+0.415091457 container start e13a4e882c6107ada8633d6b9ad94f8b50018c045a13f5ae771317cc52c50aad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T23:29:20.580 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:20 smithi073 podman[73467]: 2024-09-10 23:29:20.51739146 +0000 UTC m=+0.516080475 container attach e13a4e882c6107ada8633d6b9ad94f8b50018c045a13f5ae771317cc52c50aad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:29:20.956 INFO:journalctl@ceph.osd.4.smithi073.stdout:Sep 10 23:29:20 smithi073 podman[73467]: 2024-09-10 23:29:20.900092749 +0000 UTC m=+0.898781747 container died e13a4e882c6107ada8633d6b9ad94f8b50018c045a13f5ae771317cc52c50aad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:29:20.956 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:20 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:20.652+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:20.956 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:20 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:20.652+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:21.214 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:20 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:20.954+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:21.214 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:20 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:20.954+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:21.215 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:21 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:21.155+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:21.215 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:21 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:21.155+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:21.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T23:29:21.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:29:21.647 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T23:29:21.647 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T23:29:21.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.5 2024-09-10T23:29:21.830 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:21 smithi073 systemd[1]: Stopping Ceph osd.5 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:29:21.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:21 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:21.615+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:21.831 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:21 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:21.615+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:22.203 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:21 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:21.929+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:22.204 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:21 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:21.929+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:22.204 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:22.068+0000 7ff110c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:29:22.204 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:22.068+0000 7ff110c00640 -1 osd.5 65 *** Got signal Terminated *** 2024-09-10T23:29:22.204 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:22.068+0000 7ff110c00640 -1 osd.5 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:29:22.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:22.202+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:22.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:22.202+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:22.929 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:22.587+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:22.929 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:22.587+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:23.246 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:22.928+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:23.246 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:22 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:22.928+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:23.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:23.245+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:23.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:23.245+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:23.930 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:23.623+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:23.931 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:23.623+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:23.931 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:23.623+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:24.209 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:23.930+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:24.209 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:23.930+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:24.209 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:23 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:23.930+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:59.420597+0000 front 2024-09-10T23:28:59.420639+0000 (oldest deadline 2024-09-10T23:29:23.520528+0000) 2024-09-10T23:29:24.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:24.208+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:24.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:24.208+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:24.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:24.208+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:24.887 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:24.624+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:24.887 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:24.624+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:24.887 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:24.624+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:25.228 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:24.886+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:25.228 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:24.886+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:25.228 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:24 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:24.886+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:59.420597+0000 front 2024-09-10T23:28:59.420639+0000 (oldest deadline 2024-09-10T23:29:23.520528+0000) 2024-09-10T23:29:25.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:25.227+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:25.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:25.227+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:25.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:25.227+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:25.915 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:25.636+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:25.916 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:25.636+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:25.916 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:25.636+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:26.265 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:25.915+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:26.265 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:25.915+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:26.265 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:25 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:25.915+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:59.420597+0000 front 2024-09-10T23:28:59.420639+0000 (oldest deadline 2024-09-10T23:29:23.520528+0000) 2024-09-10T23:29:26.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:26.264+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:26.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:26.264+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:26.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:26.264+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:26.946 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:26.660+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:26.946 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:26.660+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:26.946 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:26.660+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:27.277 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:26.945+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:39.615602+0000 front 2024-09-10T23:28:39.615967+0000 (oldest deadline 2024-09-10T23:29:04.915794+0000) 2024-09-10T23:29:27.277 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:26.945+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.817285+0000 front 2024-09-10T23:28:50.817420+0000 (oldest deadline 2024-09-10T23:29:14.317489+0000) 2024-09-10T23:29:27.277 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:26 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5[46980]: 2024-09-10T23:29:26.945+0000 7ff107600640 -1 osd.5 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:59.420597+0000 front 2024-09-10T23:28:59.420639+0000 (oldest deadline 2024-09-10T23:29:23.520528+0000) 2024-09-10T23:29:27.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:27 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:27.275+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:27.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:27 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:27.275+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:27.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:27 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:27.275+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:27.951 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:27 smithi073 podman[73568]: 2024-09-10 23:29:27.645384559 +0000 UTC m=+5.716291123 container died dc1a958933615bc3b636a9915de45b2a219c2ba8cb357020fb18ca33a8b9581f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T23:29:27.951 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:27 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:27.650+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:27.951 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:27 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:27.650+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:27.951 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:27 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:27.650+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:28.245 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:28 smithi073 podman[73568]: 2024-09-10 23:29:28.065947272 +0000 UTC m=+6.136853828 container cleanup dc1a958933615bc3b636a9915de45b2a219c2ba8cb357020fb18ca33a8b9581f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:29:28.245 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:28 smithi073 bash[73568]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5 2024-09-10T23:29:28.579 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:28 smithi073 podman[73587]: 2024-09-10 23:29:28.325697338 +0000 UTC m=+0.672324615 container remove dc1a958933615bc3b636a9915de45b2a219c2ba8cb357020fb18ca33a8b9581f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-10T23:29:28.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:28 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:28.244+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:28.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:28 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:28.244+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:28.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:28 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:28.244+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:28.888 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:28 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:28.617+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:28.888 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:28 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:28.617+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:28.888 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:28 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:28.617+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:29.181 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:28 smithi073 podman[73673]: 2024-09-10 23:29:28.792480731 +0000 UTC m=+0.027312317 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:29:29.181 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:28 smithi073 podman[73673]: 2024-09-10 23:29:28.89377933 +0000 UTC m=+0.128610913 container create de0bb1989d3375082f49f31da8b15e29bff533518a990ab121b3452b427ba1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:29:29.181 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:29 smithi073 podman[73673]: 2024-09-10 23:29:29.18056436 +0000 UTC m=+0.415395944 container init de0bb1989d3375082f49f31da8b15e29bff533518a990ab121b3452b427ba1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:29:29.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:29 smithi073 podman[73673]: 2024-09-10 23:29:29.189428353 +0000 UTC m=+0.424259944 container start de0bb1989d3375082f49f31da8b15e29bff533518a990ab121b3452b427ba1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T23:29:29.447 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:29 smithi073 podman[73673]: 2024-09-10 23:29:29.271967708 +0000 UTC m=+0.506799302 container attach de0bb1989d3375082f49f31da8b15e29bff533518a990ab121b3452b427ba1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T23:29:29.447 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:29 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:29.248+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:29.447 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:29 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:29.248+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:29.447 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:29 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:29.248+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:29.808 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 10 23:29:29 smithi073 podman[73673]: 2024-09-10 23:29:29.446964011 +0000 UTC m=+0.681795603 container died de0bb1989d3375082f49f31da8b15e29bff533518a990ab121b3452b427ba1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:29:29.809 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:29 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:29.590+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:29.809 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:29 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:29.590+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:29.809 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:29 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:29.590+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:30.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T23:29:30.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:29:30.237 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T23:29:30.237 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T23:29:30.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.6 2024-09-10T23:29:30.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:30.261+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:30.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:30.261+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:30.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:30.261+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:30.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 systemd[1]: Stopping Ceph osd.6 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:29:31.006 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:30.639+0000 7fe30ae00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:29:31.006 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:30.639+0000 7fe30ae00640 -1 osd.6 65 *** Got signal Terminated *** 2024-09-10T23:29:31.007 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:30.639+0000 7fe30ae00640 -1 osd.6 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:29:31.007 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:30.620+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:31.007 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:30.620+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:31.007 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:30 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:30.620+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:31.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:31 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:31.265+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:31.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:31 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:31.265+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:31.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:31 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:31.265+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:32.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:31 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:31.639+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:32.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:31 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:31.639+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:32.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:31 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:31.639+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:32.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:32.258+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:32.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:32.258+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:32.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:32.258+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:32.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:32.258+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:07.778759+0000 front 2024-09-10T23:29:07.778802+0000 (oldest deadline 2024-09-10T23:29:31.278644+0000) 2024-09-10T23:29:33.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:32.609+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:33.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:32.609+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:33.081 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:32 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:32.609+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:33.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:33.283+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:33.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:33.283+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:33.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:33.283+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:33.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:33.283+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:07.778759+0000 front 2024-09-10T23:29:07.778802+0000 (oldest deadline 2024-09-10T23:29:31.278644+0000) 2024-09-10T23:29:34.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:33.622+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:34.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:33.622+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:34.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:33 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:33.622+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:34.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:34.272+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:34.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:34.272+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:34.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:34.272+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:34.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:34.272+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:07.778759+0000 front 2024-09-10T23:29:07.778802+0000 (oldest deadline 2024-09-10T23:29:31.278644+0000) 2024-09-10T23:29:35.079 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:34.593+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:35.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:34.593+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:35.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:34.593+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:35.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:34 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:34.593+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:35.579 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:35.308+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:41.573406+0000 front 2024-09-10T23:28:41.573254+0000 (oldest deadline 2024-09-10T23:29:05.073190+0000) 2024-09-10T23:29:35.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:35.308+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:47.974614+0000 front 2024-09-10T23:28:47.974761+0000 (oldest deadline 2024-09-10T23:29:13.874662+0000) 2024-09-10T23:29:35.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:35.308+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:29:00.177730+0000 front 2024-09-10T23:29:00.177557+0000 (oldest deadline 2024-09-10T23:29:23.677576+0000) 2024-09-10T23:29:35.580 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6[52680]: 2024-09-10T23:29:35.308+0000 7fe306800640 -1 osd.6 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:07.778759+0000 front 2024-09-10T23:29:07.778802+0000 (oldest deadline 2024-09-10T23:29:31.278644+0000) 2024-09-10T23:29:36.006 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:35.610+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:36.007 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:35.610+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:36.007 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:35.610+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:36.007 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:35 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:35.610+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:36.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:36 smithi073 podman[73775]: 2024-09-10 23:29:36.187297105 +0000 UTC m=+5.673821832 container died 6a15ffb58ed0f4ce40692aefa5a76a54dac889f1495f3779ad0634e9fbe718c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T23:29:36.830 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:36 smithi073 podman[73775]: 2024-09-10 23:29:36.578627184 +0000 UTC m=+6.065151906 container cleanup 6a15ffb58ed0f4ce40692aefa5a76a54dac889f1495f3779ad0634e9fbe718c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:29:36.830 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:36 smithi073 bash[73775]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6 2024-09-10T23:29:36.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:36 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:36.576+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:36.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:36 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:36.576+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:36.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:36 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:36.576+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:36.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:36 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:36.576+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:37.330 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:36 smithi073 podman[73793]: 2024-09-10 23:29:36.896908725 +0000 UTC m=+0.704694014 container remove 6a15ffb58ed0f4ce40692aefa5a76a54dac889f1495f3779ad0634e9fbe718c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T23:29:37.617 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:37 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:37.575+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:37.617 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:37 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:37.575+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:37.617 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:37 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:37.575+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:37.617 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:37 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:37.575+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:37.617 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:37 smithi073 podman[73880]: 2024-09-10 23:29:37.246629351 +0000 UTC m=+0.027218166 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:29:37.618 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:37 smithi073 podman[73880]: 2024-09-10 23:29:37.364515822 +0000 UTC m=+0.145104623 container create eeac910b55ea842975697e3362ec573f06e2edb5d705c0489ed4c728f4bc1759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T23:29:37.618 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:37 smithi073 podman[73880]: 2024-09-10 23:29:37.617117108 +0000 UTC m=+0.397705933 container init eeac910b55ea842975697e3362ec573f06e2edb5d705c0489ed4c728f4bc1759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T23:29:37.892 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:37 smithi073 podman[73880]: 2024-09-10 23:29:37.625812659 +0000 UTC m=+0.406401468 container start eeac910b55ea842975697e3362ec573f06e2edb5d705c0489ed4c728f4bc1759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T23:29:37.892 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:37 smithi073 podman[73880]: 2024-09-10 23:29:37.708397064 +0000 UTC m=+0.488985873 container attach eeac910b55ea842975697e3362ec573f06e2edb5d705c0489ed4c728f4bc1759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:29:38.230 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 23:29:37 smithi073 podman[73880]: 2024-09-10 23:29:37.892531611 +0000 UTC m=+0.673120419 container died eeac910b55ea842975697e3362ec573f06e2edb5d705c0489ed4c728f4bc1759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:29:38.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T23:29:38.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:29:38.631 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T23:29:38.631 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T23:29:38.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.7 2024-09-10T23:29:38.829 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:38 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:38.611+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:38.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:38 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:38.611+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:38.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:38 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:38.611+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:38.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:38 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:38.611+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:38.830 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:38 smithi073 systemd[1]: Stopping Ceph osd.7 for 52773b64-6fc7-11ef-bcea-c7b262605968... 2024-09-10T23:29:39.329 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.036+0000 7f79de000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:29:39.330 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.036+0000 7f79de000640 -1 osd.7 65 *** Got signal Terminated *** 2024-09-10T23:29:39.330 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.036+0000 7f79de000640 -1 osd.7 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:29:40.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.631+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:40.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.631+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:40.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.631+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:40.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:39 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:39.631+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:41.009 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:40 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:40.675+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:41.010 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:40 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:40.675+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:41.010 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:40 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:40.675+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:41.010 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:40 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:40.675+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:41.960 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:41 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:41.682+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:41.961 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:41 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:41.682+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:41.961 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:41 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:41.682+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:41.961 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:41 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:41.682+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:43.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:42 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:42.711+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:43.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:42 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:42.711+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:43.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:42 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:42.711+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:43.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:42 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:42.711+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:44.081 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:43 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:43.724+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-10T23:28:43.781300+0000 front 2024-09-10T23:28:43.781360+0000 (oldest deadline 2024-09-10T23:29:06.681528+0000) 2024-09-10T23:29:44.081 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:43 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:43.724+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-10T23:28:50.683139+0000 front 2024-09-10T23:28:50.683237+0000 (oldest deadline 2024-09-10T23:29:14.183080+0000) 2024-09-10T23:29:44.081 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:43 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:43.724+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-09-10T23:28:58.185089+0000 front 2024-09-10T23:28:58.185147+0000 (oldest deadline 2024-09-10T23:29:23.484894+0000) 2024-09-10T23:29:44.081 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:43 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:43.724+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.46:6830 osd.3 since back 2024-09-10T23:29:09.385994+0000 front 2024-09-10T23:29:09.385917+0000 (oldest deadline 2024-09-10T23:29:34.586290+0000) 2024-09-10T23:29:44.081 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:43 smithi073 ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7[58951]: 2024-09-10T23:29:43.724+0000 7f79d9a00640 -1 osd.7 65 heartbeat_check: no reply from 172.21.15.73:6804 osd.4 since back 2024-09-10T23:29:14.586958+0000 front 2024-09-10T23:29:14.586884+0000 (oldest deadline 2024-09-10T23:29:43.387279+0000) 2024-09-10T23:29:44.933 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:44 smithi073 podman[73984]: 2024-09-10 23:29:44.598948765 +0000 UTC m=+5.699983970 container died 555d466459592a2bc4c4c263ec638fc20bec34e9c4bd6ea9ace687b12af4d681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T23:29:45.300 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:45 smithi073 podman[73984]: 2024-09-10 23:29:45.065699209 +0000 UTC m=+6.166734406 container cleanup 555d466459592a2bc4c4c263ec638fc20bec34e9c4bd6ea9ace687b12af4d681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:29:45.300 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:45 smithi073 bash[73984]: ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7 2024-09-10T23:29:45.579 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:45 smithi073 podman[74015]: 2024-09-10 23:29:45.300167824 +0000 UTC m=+0.693101813 container remove 555d466459592a2bc4c4c263ec638fc20bec34e9c4bd6ea9ace687b12af4d681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T23:29:46.079 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:45 smithi073 podman[74105]: 2024-09-10 23:29:45.732128295 +0000 UTC m=+0.027084851 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:29:46.079 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:45 smithi073 podman[74105]: 2024-09-10 23:29:45.843004999 +0000 UTC m=+0.137961554 container create 04e11e04e305b3b16c42f96e807cea4e8f505b4ad7dd0c252ec5ddbadafb447e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T23:29:46.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:46 smithi073 podman[74105]: 2024-09-10 23:29:46.070510695 +0000 UTC m=+0.365467254 container init 04e11e04e305b3b16c42f96e807cea4e8f505b4ad7dd0c252ec5ddbadafb447e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T23:29:46.080 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:46 smithi073 podman[74105]: 2024-09-10 23:29:46.07935538 +0000 UTC m=+0.374311947 container start 04e11e04e305b3b16c42f96e807cea4e8f505b4ad7dd0c252ec5ddbadafb447e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:29:46.329 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:46 smithi073 podman[74105]: 2024-09-10 23:29:46.162216808 +0000 UTC m=+0.457173375 container attach 04e11e04e305b3b16c42f96e807cea4e8f505b4ad7dd0c252ec5ddbadafb447e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:29:46.822 INFO:journalctl@ceph.osd.7.smithi073.stdout:Sep 10 23:29:46 smithi073 podman[74105]: 2024-09-10 23:29:46.333734084 +0000 UTC m=+0.628690644 container died 04e11e04e305b3b16c42f96e807cea4e8f505b4ad7dd0c252ec5ddbadafb447e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-52773b64-6fc7-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T23:29:47.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52773b64-6fc7-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T23:29:47.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:29:47.233 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T23:29:47.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:29:47.519 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T23:30:19.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:30:19.452 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T23:30:38.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:30:38.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:30:38.615 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T23:30:38.617 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755/remote/smithi046/crash 2024-09-10T23:30:38.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:30:38.688 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:30:38.688 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:30:38.691 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755/remote/smithi073/crash 2024-09-10T23:30:38.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:30:38.787 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:30:38.787 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:30:38.789 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T23:30:38.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T23:30:38.933 INFO:tasks.cephadm:Compressing logs... 2024-09-10T23:30:38.933 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:30:38.937 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:30:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T23:30:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2024-09-10T23:30:39.001 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mon.smithi046.log 2024-09-10T23:30:39.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.foo.smithi046.twlkrf.log 2024-09-10T23:30:39.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mon.smithi046.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T23:30:39.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.foo.smithi046.twlkrf.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mgr.smithi046.eocvws.log 2024-09-10T23:30:39.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:30:39.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mgr.smithi046.eocvws.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:30:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.bar.smithi046.pyflwx.log 2024-09-10T23:30:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi046.log 2024-09-10T23:30:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.bar.smithi046.pyflwx.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:30:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi046.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T23:30:39.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:30:39.011 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T23:30:39.011 INFO:teuthology.orchestra.run.smithi073.stderr:: No such file or directory 2024-09-10T23:30:39.011 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:30:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T23:30:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-10T23:30:39.012 INFO:teuthology.orchestra.run.smithi046.stderr: 94.5% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi046.log.gz 2024-09-10T23:30:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:30:39.013 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T23:30:39.013 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:30:39.013 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.bar.smithi073.rklcya.log 2024-09-10T23:30:39.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 88.4% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:30:39.015 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-10T23:30:39.015 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi073.log 2024-09-10T23:30:39.015 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.bar.smithi073.rklcya.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:30:39.016 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi073.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mon.smithi073.log 2024-09-10T23:30:39.016 INFO:teuthology.orchestra.run.smithi073.stderr: 29.3% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi073.log.gz 2024-09-10T23:30:39.016 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T23:30:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mon.smithi073.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T23:30:39.018 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:30:39.019 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mgr.smithi073.lkiuuj.log 2024-09-10T23:30:39.019 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.foo.smithi073.nheemt.log 2024-09-10T23:30:39.020 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mgr.smithi073.lkiuuj.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-10T23:30:39.021 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.foo.smithi073.nheemt.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:30:39.024 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 95.0% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.bar.smithi073.rklcya.log.gz 2024-09-10T23:30:39.029 INFO:teuthology.orchestra.run.smithi073.stderr: 93.4% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mgr.smithi073.lkiuuj.log.gz 2024-09-10T23:30:39.035 INFO:teuthology.orchestra.run.smithi073.stderr: 93.3% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.foo.smithi073.nheemt.log.gz 2024-09-10T23:30:39.109 INFO:teuthology.orchestra.run.smithi073.stderr: 83.9% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:30:39.145 INFO:teuthology.orchestra.run.smithi073.stderr: 91.8% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:30:39.152 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:30:39.215 INFO:teuthology.orchestra.run.smithi073.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:30:39.265 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:30:39.272 INFO:teuthology.orchestra.run.smithi073.stderr: 90.8% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:30:39.340 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:30:39.368 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:30:39.540 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:30:39.866 INFO:teuthology.orchestra.run.smithi046.stderr: 94.7% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.foo.smithi046.twlkrf.log.gz 2024-09-10T23:30:42.069 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mgr.smithi046.eocvws.log.gz 2024-09-10T23:30:45.357 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mon.smithi073.log.gz 2024-09-10T23:30:49.255 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mon.smithi046.log.gz 2024-09-10T23:31:03.928 INFO:teuthology.orchestra.run.smithi073.stderr: 94.0% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T23:31:06.994 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T23:31:08.121 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T23:31:24.682 INFO:teuthology.orchestra.run.smithi073.stderr: 94.1% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T23:31:34.826 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T23:31:46.510 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T23:31:56.174 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T23:31:58.113 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T23:36:30.594 INFO:teuthology.orchestra.run.smithi073.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-10T23:36:31.563 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-10T23:36:31.563 INFO:teuthology.orchestra.run.smithi073.stderr:real 5m51.626s 2024-09-10T23:36:31.563 INFO:teuthology.orchestra.run.smithi073.stderr:user 4m58.345s 2024-09-10T23:36:31.563 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m37.514s 2024-09-10T23:40:52.255 INFO:teuthology.orchestra.run.smithi046.stderr: 94.4% -- replaced with /var/log/ceph/52773b64-6fc7-11ef-bcea-c7b262605968/ceph-mds.bar.smithi046.pyflwx.log.gz 2024-09-10T23:40:52.288 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-10T23:40:52.288 INFO:teuthology.orchestra.run.smithi046.stderr:real 10m13.292s 2024-09-10T23:40:52.288 INFO:teuthology.orchestra.run.smithi046.stderr:user 7m55.913s 2024-09-10T23:40:52.288 INFO:teuthology.orchestra.run.smithi046.stderr:sys 1m5.898s 2024-09-10T23:40:52.290 INFO:tasks.cephadm:Archiving logs... 2024-09-10T23:40:52.290 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755/remote/smithi046/log 2024-09-10T23:40:52.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:41:55.438 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755/remote/smithi073/log 2024-09-10T23:41:55.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:42:43.442 INFO:tasks.cephadm:Removing cluster... 2024-09-10T23:42:43.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 --force 2024-09-10T23:42:43.814 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T23:42:45.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52773b64-6fc7-11ef-bcea-c7b262605968 --force 2024-09-10T23:42:46.017 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: 52773b64-6fc7-11ef-bcea-c7b262605968 2024-09-10T23:42:46.599 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T23:42:46.599 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:46.650 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:46.685 INFO:tasks.cephadm:Teardown complete 2024-09-10T23:42:46.686 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T23:42:46.696 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T23:42:46.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:42:46.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:42:46.859 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T23:42:46.869 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T23:42:46.869 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:42:46.874 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:42:46.905 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:42:46.907 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:42:46.988 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:42:46.988 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-10T23:42:46.988 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -314us[ -272us] +/- 49ms 2024-09-10T23:42:46.989 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +363us[ +405us] +/- 80ms 2024-09-10T23:42:46.989 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +152us[ +194us] +/- 64ms 2024-09-10T23:42:46.989 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:42:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:42:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-10T23:42:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -298us[ -277us] +/- 49ms 2024-09-10T23:42:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +372us[ +392us] +/- 80ms 2024-09-10T23:42:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +166us[ +186us] +/- 64ms 2024-09-10T23:42:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:42:47.020 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T23:42:47.029 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T23:42:47.030 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T23:42:47.066 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:42:47.310 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:42:47.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T23:42:47.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:42:47.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T23:42:47.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:42:47.598 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T23:42:47.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T23:42:47.665 INFO:teuthology.task.internal:Duration was 3472.436547 seconds 2024-09-10T23:42:47.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T23:42:47.720 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T23:42:47.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:42:47.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:42:47.820 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:42:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:42:48.192 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T23:42:48.192 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-09-10T23:42:48.192 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:42:48.248 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T23:42:48.249 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:42:48.307 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T23:42:48.307 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:42:48.312 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:42:48.382 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T23:42:48.382 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:42:48.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:42:48.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T23:42:48.933 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T23:42:48.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:42:48.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:42:49.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T23:42:49.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:42:49.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:42:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-09-10T23:42:49.145 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-10T23:42:49.179 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:42:49.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:42:49.212 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:42:49.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:42:49.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T23:42:49.256 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T23:42:49.258 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755/remote/smithi046 2024-09-10T23:42:49.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:42:49.330 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899755/remote/smithi073 2024-09-10T23:42:49.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:42:49.395 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T23:42:49.395 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:42:49.399 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:42:49.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T23:42:49.446 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T23:42:49.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T23:42:49.518 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T23:42:49.519 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:42:49.523 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:42:49.553 INFO:teuthology.orchestra.run.smithi046.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:42 /home/ubuntu/cephtest 2024-09-10T23:42:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:42 /home/ubuntu/cephtest 2024-09-10T23:42:49.560 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T23:42:49.574 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T23:42:49.714 INFO:teuthology.run:Summary data: description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} duration: 3472.436547279358 flavor: default host.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a host.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T23:42:49.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:42:49.796 INFO:teuthology.run:pass